-- Logs begin at Tue 2022-08-30 00:36:41 UTC, end at Tue 2022-08-30 01:35:23 UTC. -- Aug 30 01:07:39.343007 dv-cinder-815145-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 01:07:39.351876 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 01:07:39.353891 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 01:07:39 2022] *** Aug 30 01:07:39.353891 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 01:07:39.353891 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 01:07:39.353891 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: nodename: dv-cinder-815145-12-iscsi Aug 30 01:07:39.353891 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: machine: x86_64 Aug 30 01:07:39.353891 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: clock source: unix Aug 30 01:07:39.353891 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: pcre jit disabled Aug 30 01:07:39.353891 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: detected number of CPU cores: 4 Aug 30 01:07:39.353891 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: current working directory: / Aug 30 01:07:39.353891 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: detected binary path: /usr/bin/uwsgi-core Aug 30 01:07:39.354637 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: your processes number limit is 47680 Aug 30 01:07:39.354637 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: your memory page size is 4096 bytes Aug 30 01:07:39.354637 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: detected max file descriptor number: 2048 Aug 30 01:07:39.354637 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: lock engine: pthread robust mutexes Aug 30 01:07:39.354637 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: thunder lock: enabled Aug 30 01:07:39.354637 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 01:07:39.354637 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 01:07:39.393357 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: Python main interpreter initialized at 0x564d0ef6b9c0 Aug 30 01:07:39.393357 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: python threads support enabled Aug 30 01:07:39.393357 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: your server socket listen backlog is limited to 100 connections Aug 30 01:07:39.393357 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: your mercy for graceful operations on workers is 90 seconds Aug 30 01:07:39.393743 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 01:07:39.393820 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: *** Operational MODE: preforking *** Aug 30 01:07:39.394029 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: *** uWSGI is running in multiple interpreter mode *** Aug 30 01:07:39.394029 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: spawned uWSGI master process (pid: 105682) Aug 30 01:07:39.394230 dv-cinder-815145-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 01:07:39.394815 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: spawned uWSGI worker 1 (pid: 105683, cores: 1) Aug 30 01:07:39.396040 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: spawned uWSGI worker 2 (pid: 105684, cores: 1) Aug 30 01:07:39.396040 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 01:07:40.071121 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:07:40.078510 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:07:41.180330 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:07:41.180330 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: from cryptography.utils import int_from_bytes Aug 30 01:07:41.180942 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:07:41.180942 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: from cryptography.utils import int_from_bytes Aug 30 01:07:41.201368 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:07:41.201368 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: from cryptography.utils import int_from_bytes Aug 30 01:07:41.202097 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:07:41.202097 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: from cryptography.utils import int_from_bytes Aug 30 01:07:43.710150 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:07:43.710714 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:07:43.710792 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:07:43.711117 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:07:43.711205 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:07:43.711362 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:07:43.711562 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:07:43.711651 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:07:43.711908 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:07:43.712038 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.712191 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:07:43.712309 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.712566 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.712652 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.712885 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.712983 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.713200 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.713283 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.713511 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.713615 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.713829 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.713916 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.714134 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.714216 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.714449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.714542 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.714708 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.714800 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.715023 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.715118 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.715321 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.715417 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815145-12-iscsi {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.715633 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.715718 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.715944 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.716058 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815145-12-iscsi {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.716273 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.716369 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.716574 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.716656 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.716876 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.716957 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.717187 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.717333 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.717486 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.717583 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.717802 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.717990 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.718103 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.718436 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.718611 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.718750 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.718902 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.719043 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.719202 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.719387 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.719491 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.719701 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.719884 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.720025 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.720161 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.720362 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.720486 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.720666 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.720776 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.720973 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.721063 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.721280 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.721380 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.721621 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.721718 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815145-12-iscsi {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.721987 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.722085 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815145-12-iscsi {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.722299 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.722401 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.723246 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.723356 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.723741 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.724236 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.724356 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.724562 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.724663 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.724877 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.724967 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.725203 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.725303 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.725537 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.725719 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.725872 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.726028 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.726162 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.726304 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.726435 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.726576 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.726753 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.726846 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.727067 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.727160 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.727369 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.727489 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.727672 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.727762 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.727977 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.728133 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.728315 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.728452 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.728620 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.728723 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.728922 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.729012 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.729170 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.729259 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.729469 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.729565 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.729783 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.729879 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.730096 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.730185 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.730412 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.730504 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.730664 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.730763 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.730908 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.731070 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.731222 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.731318 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.731540 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.731688 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.731842 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.731971 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.732172 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.732313 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.732474 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.732604 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.732774 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.732904 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.733075 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.733204 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.733381 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.733515 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.733681 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.733813 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.733981 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.734109 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.734292 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.734421 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.734602 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.734731 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.734918 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.735054 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.735219 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.735346 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.735532 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.735682 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.735925 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.736127 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.736213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.736289 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.736487 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.736573 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.736822 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.736928 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.737138 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.737228 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.737444 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.737535 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.737751 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.737845 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.738066 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.738153 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.738959 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.739196 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.739291 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.739544 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.739729 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.739862 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.740137 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.740228 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.743600 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.743731 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.748104 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.748220 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.748361 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.748462 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.748558 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.748645 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.748728 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.748854 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.748943 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.749029 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.749115 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.749240 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.749329 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.749407 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.749483 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.749558 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.749643 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.749722 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.749805 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.749881 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.749957 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.750040 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.750117 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.750240 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.750328 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.750412 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.750489 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.750574 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.750651 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.750727 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.750802 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.750878 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.750953 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.751037 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.751115 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.751197 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.751274 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.751349 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.751424 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.751513 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.751591 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.751666 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.751741 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.751828 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.751988 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.752099 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.752179 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.752255 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.752339 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.752423 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.752500 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.752584 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.752668 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.752745 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.752821 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.752902 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.752902 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.753059 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.753137 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.753213 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.753289 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.753380 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.753469 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.753558 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.753640 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.753716 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.753797 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.753879 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.754022 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.754135 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.754220 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.754342 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.754424 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.754519 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.754672 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.754763 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.754852 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.754931 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755007 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755082 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755168 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755247 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755323 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755406 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755483 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755560 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755645 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755722 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755798 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755887 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755972 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.755972 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.756233 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.756319 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.756405 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.756482 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.756565 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.756651 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.756742 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.756827 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.756905 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.756981 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.757076 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.757171 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.757256 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.757333 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.757409 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:07:43.757491 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.757568 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.757655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.757734 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.757809 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.757885 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.758017 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.758176 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.758318 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.758408 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.758631 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.758717 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.758957 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.759050 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.759276 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.759361 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.759589 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.759680 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.759901 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.760020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.760271 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.760384 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.760544 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.760630 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.760840 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.760932 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.761151 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.761247 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.761464 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.761550 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.761780 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.761873 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.762089 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.762175 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.762398 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.762483 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.762711 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.762811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.763022 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.763138 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.763328 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.763414 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.763648 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.763741 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.763972 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.764102 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.764329 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.764431 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.764655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.764754 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.764983 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.765075 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.765295 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.765380 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.765609 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.765708 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.765916 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.766002 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.766228 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.766360 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.766537 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.766624 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.766841 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.766940 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.767159 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.767254 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.767471 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.767561 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.767781 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.767866 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.768122 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.768355 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.768442 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.768518 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.768735 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.768829 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.769041 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.769139 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.769349 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.769436 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.769713 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.769843 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.770031 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.770354 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.770452 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.770672 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.770764 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.770984 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.771079 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.771302 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.771389 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.771614 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.771700 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.771925 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.772095 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.772264 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.772351 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.772569 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.772654 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.772874 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.772971 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.773181 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.773281 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.773484 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.773572 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.773783 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.773876 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.774084 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.774177 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.774391 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.774478 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.774695 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.774789 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.774997 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.775083 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.775313 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.775406 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.775623 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.775753 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.775925 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.776030 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.776516 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.776604 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.776821 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.776908 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.777129 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.777212 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.777436 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.777522 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.777738 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.777823 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.778035 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.778109 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.778343 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.778468 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.778647 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.778733 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.778944 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.779036 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.779260 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.779359 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.779563 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.779654 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.779861 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.779952 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.780199 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.780299 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.780560 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.780658 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.780801 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.780887 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.781108 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.781209 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.781413 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.781499 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.781719 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.781813 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.782027 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.782114 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.782332 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.782418 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.782647 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.782737 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.782955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.783048 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.783262 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.783348 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.783594 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.783679 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.783913 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.784026 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.784243 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.784332 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.784555 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.784639 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.784863 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.784951 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.785716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.785842 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.786017 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.786326 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.786477 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.786613 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.786794 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.786920 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.787102 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.787226 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.787408 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.787530 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.787712 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.787835 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.788040 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.788189 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.788345 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.788499 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.788648 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.788805 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.788949 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.789117 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.789250 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.789422 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.789551 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.789768 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.789863 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.790078 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.790165 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.790420 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.790553 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.790735 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.790829 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.791034 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.791120 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.791372 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.791459 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.791675 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.791770 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.792001 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.792088 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.792326 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.792421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.792640 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.792735 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.792953 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.793038 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.793264 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.793350 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.793577 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.793670 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.793884 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.793969 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.794197 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.794295 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.794504 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.794642 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.794812 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.794899 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.795121 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.795205 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.795426 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.795513 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.795730 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.795813 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.796061 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.796149 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.796382 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.796478 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.796692 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.796796 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.797006 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.797092 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.797306 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.797394 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.797618 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.797705 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.797929 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.798098 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.798242 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.798329 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.798554 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.798678 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.798866 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.798962 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.799168 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.799261 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.799477 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.799570 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.799784 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.799881 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.800112 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.800200 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.800420 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.800508 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.800752 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.801468 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.801757 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.802089 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.802319 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.802415 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.802653 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.802751 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.802980 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.803075 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.803294 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.803381 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.803623 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.803711 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.803936 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.804059 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.804300 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.804439 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.804590 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.804713 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.804901 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.804987 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.805214 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.805299 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.805522 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.805611 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.805830 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.805923 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.806139 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.806225 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.806454 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.806540 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.806808 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.806907 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.807061 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.807158 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.807362 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.807448 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.807671 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.807791 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.807973 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.808151 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.808306 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.808401 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.808613 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.808707 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.808918 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.809018 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.809225 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.809311 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.809526 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.809611 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.809836 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.809931 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.810141 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.810237 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.810444 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.810537 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.810743 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.810831 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.811054 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.811140 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.811360 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.811444 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.811665 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.811752 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.811976 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.812091 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.812306 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.812393 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.812607 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.812694 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.812910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.813007 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.813230 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.813325 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.813538 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.813625 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.813841 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.813935 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.814155 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.814341 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.814473 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.814646 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.814783 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.814989 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.815074 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.815296 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.815383 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.815599 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.815683 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.815912 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.816017 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.816257 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.816387 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.816633 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.817098 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.817415 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.817500 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.817731 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.817825 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.818055 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.818141 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.818366 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.818466 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.818678 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.818764 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.818990 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.819075 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.819297 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.819389 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.819607 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.819701 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.819914 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.820068 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.820251 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.820526 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.820614 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.820861 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.820946 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.821167 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.821258 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.821474 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.821569 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.821775 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.821860 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.822082 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.822175 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.822394 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.822493 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.822754 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.822968 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.823062 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.823304 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.823389 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.823619 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.823706 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.823937 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.824054 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.824266 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.824360 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.824577 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.824663 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.824882 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.825023 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.825187 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.825274 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.825490 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.825589 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.825800 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.825887 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.826103 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.826193 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.826406 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.826493 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.826704 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.826788 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.827045 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.827142 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.827301 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.827387 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.827601 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.827685 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.827902 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.828011 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.828232 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.828322 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.828529 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.828612 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.828829 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.828917 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.829131 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.829219 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.829432 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.829526 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.829732 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.829826 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.830030 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.830115 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.830338 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.830423 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.830638 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.830733 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.830954 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.831048 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.831257 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.831344 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.831563 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.831689 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.831866 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.831986 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.832267 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.832609 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.832806 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.832902 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.833068 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.833162 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.833374 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.833460 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.833710 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.833805 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.834037 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.834130 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.834347 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.834431 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.834657 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.834746 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.834962 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.835046 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.835267 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.835354 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.835570 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.835657 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.835868 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.835959 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.836193 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.836292 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.836500 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.836584 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.836807 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.836965 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.837125 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.837233 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.837402 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.837488 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.837706 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.837798 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.838009 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.838108 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.838313 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.838401 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.838610 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.838694 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.838926 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.839046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.839190 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.839277 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.839585 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.839675 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.839790 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.839878 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.840110 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.840212 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.840408 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.840496 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.840723 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.840814 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.841016 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.841208 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.841297 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.841375 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.841623 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.841750 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.841883 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.842552 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.842650 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.842730 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.842818 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.842898 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.842975 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.843052 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.843138 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.843226 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.843334 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.843421 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.843639 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.843726 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.843938 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.844092 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.844284 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.844383 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.844590 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.844683 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.844892 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.844990 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.845191 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.845278 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.845494 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.845578 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.845790 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.845883 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.846090 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.846174 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.846391 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.846475 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.846690 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.846776 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.846993 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.847079 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.847290 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.847377 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.848131 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.848240 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.848446 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.848751 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.848952 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.849039 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.849266 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.849354 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.849571 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.849665 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.849878 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.849964 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.850178 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.850314 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.850479 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.850621 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.850779 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.850937 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.851080 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.851256 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.851379 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.851567 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.851698 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.851879 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.852048 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.852218 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.852330 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.852523 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.852631 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.852838 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.852927 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.853148 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.853360 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.853445 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.853665 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.853764 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.854016 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.854101 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.854315 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.854401 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.854624 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.854710 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.854934 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.855018 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.855241 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.855373 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.855555 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.855642 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.855863 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.855955 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.856191 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.856276 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.856500 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.856587 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.856804 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.856891 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.857107 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.857198 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.857403 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.857488 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.857700 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.857786 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.858008 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.858091 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.858311 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.858397 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.858618 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.858710 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.858924 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.859017 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.859231 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.859318 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.859535 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.859621 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.859832 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.859926 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.860160 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.860249 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.860463 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.860547 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.860767 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.860869 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.861071 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.861157 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.861403 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.861501 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.861769 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.861881 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.861975 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.862068 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.862278 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.862369 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.862577 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.862670 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.862879 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.863009 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.863179 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.863879 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.864306 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.864580 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.864706 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.864898 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.865019 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.865204 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.865332 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.865533 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.865650 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.865841 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.865963 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.866145 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.866268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.866452 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.866684 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.866777 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.866997 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.867091 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.867307 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.867392 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.867619 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.867746 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.867925 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.868079 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.868265 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.868378 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.868577 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.868666 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.868901 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.869001 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.869205 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.869291 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.869510 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.869596 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.869821 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.869916 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.870139 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.870224 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.870444 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.870549 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.870765 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.870852 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.871147 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.871232 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.871455 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.871543 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.871755 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.871841 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.872081 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.872201 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.872387 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.872512 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.872706 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.872822 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.873004 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.873143 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.873305 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.873463 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.873605 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.873785 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.873920 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.874091 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.874221 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.874404 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.874537 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.874712 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.874946 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.875057 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.875257 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.875353 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.875557 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.875651 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.875932 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.876037 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.876262 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.876348 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.876574 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.876671 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.876891 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.876976 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.877202 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.877286 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.877515 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.877658 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.877816 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.877924 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.878122 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.878245 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.878427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.878556 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.878743 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.878941 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.879431 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.879643 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.879919 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.880052 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.880256 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.880343 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.880571 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.880656 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.880882 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.880977 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.881193 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.881285 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.881501 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.881586 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.881810 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.881903 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.882130 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.882255 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.882444 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.882534 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.882744 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.882835 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.883050 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.883143 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.883361 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.883463 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.883682 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.883775 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.883986 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.884119 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.884319 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.884421 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.884621 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.884713 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.884921 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.885012 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.885240 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.885346 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.885609 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.885704 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.885854 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.885944 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.886157 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.886255 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.886460 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.886545 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.886757 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.886842 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.887058 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.887147 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.887373 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.887469 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.887673 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.887760 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.888042 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.888132 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.888319 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.888404 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.888634 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.888734 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.888949 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.889035 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.889247 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.889333 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.889564 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.889657 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.889869 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.889957 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.890168 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.890261 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.890468 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.890563 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.890767 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.890858 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.891098 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.891189 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.891395 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.891488 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.891699 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.891785 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.892026 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.892130 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.892339 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.892447 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.892648 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.892743 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.892953 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.893051 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.893260 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.893348 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.893568 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.893660 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.893890 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.893977 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.894193 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.894280 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.894546 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.894643 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.895034 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.895345 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.895440 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.895651 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.895785 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.895958 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.896076 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.896289 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.896382 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.896592 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.896678 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.896899 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.896996 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.897200 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.897304 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.897502 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.897588 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.897801 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.897886 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.898119 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.898208 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.898418 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.898503 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.898735 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.898820 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.899040 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.899127 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.899344 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.899451 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.899650 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.899752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.899952 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.900089 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.900287 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.900373 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.900598 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.900683 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.900912 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.901007 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.901484 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.901736 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.901823 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.902068 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.902156 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.902386 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.902492 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.902697 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.902788 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.903005 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.903104 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.903315 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.903407 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.903626 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.903716 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.903935 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.904046 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.904269 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.904412 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.904577 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.904681 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.904884 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.904969 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.905195 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.905281 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.905517 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.905748 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.905873 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.906078 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.906165 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.906391 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.906477 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.906705 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.906793 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.907016 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.907102 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.907329 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.907423 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.907642 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.907776 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.907953 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.908060 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.908287 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.908385 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.908596 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.908683 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.908905 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.908990 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.909230 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.909371 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.909544 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.909630 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.909862 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.909946 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.910703 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.911017 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.911296 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.911397 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.911624 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.911711 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.911956 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.912114 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.912278 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.912489 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.912622 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.912704 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.912927 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.913014 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.913238 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.913323 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.913544 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.913642 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.913857 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.913943 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.914170 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.914254 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.914481 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.914691 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.914778 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.915011 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.915097 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.915348 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.915447 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.915677 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.915764 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.915985 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.916127 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.916324 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.916428 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.916636 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.916723 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.916948 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.917034 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.917257 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.917351 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.917562 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.917649 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.917874 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.917967 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.918182 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.918284 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.918486 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.918572 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.918793 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.918878 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.919104 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.919313 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.919442 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.919630 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.919720 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.919964 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.920124 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.920316 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.920556 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.920644 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.920904 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.921000 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.921223 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.921355 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.921550 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.921637 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.921854 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.921948 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.922157 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.922243 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.922466 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.922554 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.922773 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.922867 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.923073 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.923160 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.923376 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.923460 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.923684 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.923847 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.923986 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.924097 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.924313 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.924398 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.924616 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.924711 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.924924 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.925141 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.925228 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.925483 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.925579 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.926593 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.926725 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.926907 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.927027 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.927238 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.927453 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.927542 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.927772 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.927858 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.928107 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.928198 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.928431 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.928526 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.928736 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.928839 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.929042 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.929128 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.929346 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.929432 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.929650 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.929740 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.929952 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.930050 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.930256 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.930342 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.930561 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.930645 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.930865 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.930958 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.931170 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.931256 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.931472 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.931556 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.931773 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.931871 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.932126 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.932217 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.932432 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.932519 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.932735 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.932837 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.933037 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.933130 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.933345 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.933431 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.933647 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.933734 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.933948 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.934033 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.934251 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.934336 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.934551 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.934638 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.934859 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.934946 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.935159 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.935252 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.935463 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.935717 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.935803 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.936076 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.936165 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.936378 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.936475 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.936688 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.936811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.937034 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.937129 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.937340 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.937426 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.937639 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.937723 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.937938 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.938033 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.938250 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.938337 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.938554 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.938641 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.938860 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.938944 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.939164 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.939249 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.939468 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.939555 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.939774 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.939865 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.940115 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.940205 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.940426 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.940649 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.940735 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.940978 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.941066 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.941294 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.941461 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.941639 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.941946 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.942144 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.942255 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.942487 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.942640 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.942802 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.942931 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.943113 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.943208 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.943422 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.943508 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.943746 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.943885 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.944083 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.944187 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.944397 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.944484 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.944706 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.944806 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.945014 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.945106 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.945321 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.945406 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.945627 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.945720 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.945931 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.946023 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.946236 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.946322 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.946541 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.946629 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.946844 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.946935 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.947145 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.947260 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.947449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.947572 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.947752 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.947891 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.948080 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.948242 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.948379 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.948551 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.948711 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.948872 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.949027 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.949193 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.949342 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.949503 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.949653 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.949822 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.949964 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.950139 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.950268 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.950466 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.950560 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.950807 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.950895 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.951134 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.951220 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.951451 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.951536 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.951753 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.951839 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.952083 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.952173 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.952385 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.952480 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.952693 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.952787 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.953010 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.953103 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.953320 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.953406 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.953621 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.953783 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.953923 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.954065 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.954232 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.954398 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.954537 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.954716 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.954843 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.955022 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.955146 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.955339 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.955435 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.955646 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.955734 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.955968 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.956124 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.956329 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.956429 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.956637 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.956723 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.956960 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.957057 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.957267 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.957656 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.957742 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.957974 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.958061 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.958281 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.958366 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.958588 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.958675 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.958892 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.958978 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.959196 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.959292 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.959500 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.959586 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.959821 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.959904 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.960207 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.960311 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.960468 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.960554 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.960774 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.960866 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.961082 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.961183 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.961387 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.961492 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.961695 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.961789 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.961999 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.962093 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.962303 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.962397 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.962606 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.962692 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.962908 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.962995 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.963211 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.963296 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.963513 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.963598 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.963820 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.963915 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.964160 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.964248 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.964467 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.964551 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.964772 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.964860 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.965076 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.965162 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.965387 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.965474 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.965717 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.965805 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.966020 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.966105 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.966347 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.966440 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.966662 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.966747 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.966969 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.967060 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.967285 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.967381 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.967592 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.967678 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.967913 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.968024 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.968250 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.968345 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.968562 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.968647 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.968870 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.968954 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.969183 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.969307 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.969491 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.969584 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.969802 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.969888 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.970112 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.970198 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.970420 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.970506 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.970730 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.970822 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.971043 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.971425 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.971563 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.971713 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.971790 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.971973 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.972128 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.972319 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.972408 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.973220 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.973444 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.973643 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.973966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.974061 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.974309 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.974396 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.974640 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.974740 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.974955 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.975041 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.975268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.975354 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.975575 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.975663 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.975816 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:07:43.975911 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.976211 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.976527 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.976846 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.977162 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.977473 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.977785 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.978128 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.978414 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.978738 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.979061 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.979370 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.979690 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.980064 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.980450 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.980693 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.981032 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.981357 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.981668 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.981978 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.982281 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:07:43.982521 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:07:44.131245 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO dbcounter [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Registered counter for database nova_api Aug 30 01:07:44.142136 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO dbcounter [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] Registered counter for database nova_api Aug 30 01:07:44.153686 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_db.sqlalchemy.engines [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:07:44.161137 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writer thread running {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:07:44.164314 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG oslo_db.sqlalchemy.engines [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:07:44.170782 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG dbcounter [-] [105684] Writer thread running {{(pid=105684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:07:44.219893 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.context [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7c422da-0cce-49b5-ba78-bc23108abcf4(cell1) {{(pid=105683) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:07:44.224553 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:44.224943 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:44.226518 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:44.227263 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:44.227710 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:44.229745 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:44.231161 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.context [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7c422da-0cce-49b5-ba78-bc23108abcf4(cell1) {{(pid=105684) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:07:44.231742 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO dbcounter [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Registered counter for database nova_cell0 Aug 30 01:07:44.235023 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG oslo_concurrency.lockutils [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:44.235496 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG oslo_concurrency.lockutils [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:44.235935 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO dbcounter [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Registered counter for database nova_cell1 Aug 30 01:07:44.237086 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG oslo_concurrency.lockutils [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:44.237809 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG oslo_concurrency.lockutils [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:44.239109 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG oslo_concurrency.lockutils [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:44.241181 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG oslo_concurrency.lockutils [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:44.243241 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO dbcounter [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] Registered counter for database nova_cell0 Aug 30 01:07:44.243390 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_db.sqlalchemy.engines [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:07:44.246103 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_db.sqlalchemy.engines [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:07:44.247405 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO dbcounter [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] Registered counter for database nova_cell1 Aug 30 01:07:44.250853 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writer thread running {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:07:44.253755 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writer thread running {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:07:44.255386 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG oslo_db.sqlalchemy.engines [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:07:44.257262 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG oslo_db.sqlalchemy.engines [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:07:44.263380 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG dbcounter [-] [105684] Writer thread running {{(pid=105684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:07:44.264873 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG dbcounter [-] [105684] Writer thread running {{(pid=105684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:07:44.401320 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO dbcounter [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Registered counter for database nova_cell0 Aug 30 01:07:44.411260 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_db.sqlalchemy.engines [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:07:44.415982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writer thread running {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:07:44.418199 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO dbcounter [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] Registered counter for database nova_cell0 Aug 30 01:07:44.427491 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG oslo_db.sqlalchemy.engines [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:07:44.432177 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG dbcounter [-] [105684] Writer thread running {{(pid=105684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:07:44.756566 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: WARNING keystonemiddleware.auth_token [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:07:44.760957 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: WARNING keystonemiddleware.auth_token [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:07:44.763916 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: WARNING keystonemiddleware.auth_token [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:07:44.768344 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: WARNING keystonemiddleware.auth_token [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:07:45.108759 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: WARNING keystonemiddleware.auth_token [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:07:45.112830 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: WARNING keystonemiddleware.auth_token [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:07:45.114783 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: WARNING keystonemiddleware.auth_token [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:07:45.118766 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: WARNING keystonemiddleware.auth_token [None req-178e1268-aa32-41d2-b631-ef1ad0b28a25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:07:45.120076 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d0ef6b9c0 pid: 105683 (default app) Aug 30 01:07:45.122143 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:45.123333 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 Aug 30 01:07:45.123737 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Tue Aug 30 01:07:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:45.124038 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d0ef6b9c0 pid: 105684 (default app) Aug 30 01:09:06.274570 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:06.276485 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002189 Aug 30 01:09:06.277198 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:09:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:06.289873 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG dbcounter [-] [105684] Writing DB stats nova_api:SELECT=3 {{(pid=105684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:06.290800 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG dbcounter [-] [105684] Writing DB stats nova_cell0:SELECT=3 {{(pid=105684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:06.291983 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG dbcounter [-] [105684] Writing DB stats nova_cell1:SELECT=3 {{(pid=105684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:06.293230 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG dbcounter [-] [105684] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:07.238301 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-54706dc9-9c6b-47f8-988c-678cc16f7769 admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:07.272544 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-54706dc9-9c6b-47f8-988c-678cc16f7769 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.988104 Aug 30 01:09:07.273356 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1292 bytes} [Tue Aug 30 01:09:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:09.694484 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:09.694484 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-48e31952-a3bc-4075-8070-bf17665bccb9 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 30 01:09:09.694484 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:09:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:10.173916 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-d7990193-ec14-42c9-b295-4a223129bc72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "name": "cirros256", "id": "c1", "swap": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:10.230642 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-d7990193-ec14-42c9-b295-4a223129bc72 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.537388 Aug 30 01:09:10.231798 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Aug 30 01:09:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:09:10.245912 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writing DB stats nova_api:SELECT=3 {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:10.247324 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writing DB stats nova_cell1:SELECT=3 {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:10.248247 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writing DB stats nova_cell0:SELECT=3 {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:10.249347 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:10.461507 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-a7b46c52-0dc5-4b2b-a3c3-bef190397a34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:10.530595 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-a7b46c52-0dc5-4b2b-a3c3-bef190397a34 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290068 Aug 30 01:09:10.531126 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1336 bytes} [Tue Aug 30 01:09:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:12.953183 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-d7990193-ec14-42c9-b295-4a223129bc72 admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:12.954185 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-d7990193-ec14-42c9-b295-4a223129bc72 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 30 01:09:12.954578 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:09:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:13.691090 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-8ff6bb8d-7d6c-4835-93c3-8a566796be77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "ram": 512}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:13.735731 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-8ff6bb8d-7d6c-4835-93c3-8a566796be77 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.773556 Aug 30 01:09:13.736436 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Aug 30 01:09:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:09:13.749043 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-1bdc83d8-8a5d-456c-99e6-048c8ac87135 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:13.788470 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-1bdc83d8-8a5d-456c-99e6-048c8ac87135 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043379 Aug 30 01:09:13.788964 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1336 bytes} [Tue Aug 30 01:09:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:16.246024 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-8ff6bb8d-7d6c-4835-93c3-8a566796be77 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:16.246972 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-8ff6bb8d-7d6c-4835-93c3-8a566796be77 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 30 01:09:16.247378 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:09:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:16.615780 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-8cb9786a-3df8-4be9-b1cd-16fc64eb35f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:16.636354 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-8cb9786a-3df8-4be9-b1cd-16fc64eb35f5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.382502 Aug 30 01:09:16.636916 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Aug 30 01:09:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:09:16.649290 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-07eca064-cc0b-466a-b8d1-df519df993cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:16.676026 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-07eca064-cc0b-466a-b8d1-df519df993cf admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030314 Aug 30 01:09:16.676801 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1336 bytes} [Tue Aug 30 01:09:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:19.124114 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-8cb9786a-3df8-4be9-b1cd-16fc64eb35f5 admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:19.125071 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-8cb9786a-3df8-4be9-b1cd-16fc64eb35f5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 30 01:09:19.125501 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:09:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:19.602211 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-c727b0a9-51da-4f55-a6ff-643980f0d259 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "name": "ds2G"}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:19.628371 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-c727b0a9-51da-4f55-a6ff-643980f0d259 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496431 Aug 30 01:09:19.629159 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Aug 30 01:09:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:09:19.649128 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-b2a7863a-e5f3-4c62-8c47-3efcc4e3107c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:19.676473 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-b2a7863a-e5f3-4c62-8c47-3efcc4e3107c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037085 Aug 30 01:09:19.677726 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1336 bytes} [Tue Aug 30 01:09:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:09:22.178069 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-c727b0a9-51da-4f55-a6ff-643980f0d259 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:22.179110 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-c727b0a9-51da-4f55-a6ff-643980f0d259 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 30 01:09:22.179644 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:09:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:22.676725 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-968ae612-1423-485f-bcbc-69345f6c47ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20, "id": "d4", "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:22.699246 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-968ae612-1423-485f-bcbc-69345f6c47ad admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.502198 Aug 30 01:09:22.699803 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Aug 30 01:09:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:09:22.714635 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-3d599863-89ba-4c0f-be25-7f59b23c9769 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:22.741428 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-3d599863-89ba-4c0f-be25-7f59b23c9769 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032268 Aug 30 01:09:22.744519 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1336 bytes} [Tue Aug 30 01:09:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:25.379252 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-968ae612-1423-485f-bcbc-69345f6c47ad admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:25.380348 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-968ae612-1423-485f-bcbc-69345f6c47ad admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 30 01:09:25.380970 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:09:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:25.862154 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-bc1eb795-6f6c-4f5a-978f-495d3794548a admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:25.897404 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-bc1eb795-6f6c-4f5a-978f-495d3794548a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.508909 Aug 30 01:09:25.898062 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1292 bytes} [Tue Aug 30 01:09:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:09:28.812534 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-968ae612-1423-485f-bcbc-69345f6c47ad admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:28.813843 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-968ae612-1423-485f-bcbc-69345f6c47ad admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001922 Aug 30 01:09:28.814401 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:09:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:29.285720 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-2bccda1b-ff54-47ed-b966-c344018abb4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "swap": 0, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:29.310390 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-2bccda1b-ff54-47ed-b966-c344018abb4e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.488215 Aug 30 01:09:29.310944 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Aug 30 01:09:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:09:29.323323 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-e79d5210-a3c7-41fe-8b18-9ef55752a94d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:29.348691 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-e79d5210-a3c7-41fe-8b18-9ef55752a94d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029097 Aug 30 01:09:29.349542 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1333 bytes} [Tue Aug 30 01:09:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:31.802497 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-2bccda1b-ff54-47ed-b966-c344018abb4e admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:31.803451 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-2bccda1b-ff54-47ed-b966-c344018abb4e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 30 01:09:31.803860 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:09:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:09:32.262182 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-1819996f-09a1-4690-9330-ee73b16e4cce admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:32.284513 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-1819996f-09a1-4690-9330-ee73b16e4cce admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472730 Aug 30 01:09:32.285339 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Aug 30 01:09:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:09:32.298570 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-5f7dbfa4-53a2-43f6-bc65-ff8e7f823a72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:32.328944 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-5f7dbfa4-53a2-43f6-bc65-ff8e7f823a72 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034623 Aug 30 01:09:32.329908 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1333 bytes} [Tue Aug 30 01:09:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:34.853280 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-1819996f-09a1-4690-9330-ee73b16e4cce admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:34.855444 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-1819996f-09a1-4690-9330-ee73b16e4cce admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002712 Aug 30 01:09:34.856020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:09:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:35.367811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-6ca42327-d671-42e1-8553-33f07d15a876 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "vcpus": 2}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:35.392780 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-6ca42327-d671-42e1-8553-33f07d15a876 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.530493 Aug 30 01:09:35.394105 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Aug 30 01:09:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:09:35.407712 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-afe69ae6-84c0-44d3-b55b-b8e1dac3b746 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:35.436575 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-afe69ae6-84c0-44d3-b55b-b8e1dac3b746 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032628 Aug 30 01:09:35.437439 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1333 bytes} [Tue Aug 30 01:09:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:37.864400 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-6ca42327-d671-42e1-8553-33f07d15a876 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:37.865414 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-6ca42327-d671-42e1-8553-33f07d15a876 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 30 01:09:37.865821 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:09:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:38.355735 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-9ccbe05e-a38b-4286-add4-04a5f6f2e56e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0}} {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:38.362176 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG dbcounter [-] [105684] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:38.379248 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-9ccbe05e-a38b-4286-add4-04a5f6f2e56e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.506448 Aug 30 01:09:38.380154 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Aug 30 01:09:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:09:38.393313 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-ecfce05c-b5e3-4f50-b51c-2e6a20388003 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:38.420379 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-ecfce05c-b5e3-4f50-b51c-2e6a20388003 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030465 Aug 30 01:09:38.421218 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1333 bytes} [Tue Aug 30 01:09:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:41.005998 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-9ccbe05e-a38b-4286-add4-04a5f6f2e56e admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:41.007617 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-9ccbe05e-a38b-4286-add4-04a5f6f2e56e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Aug 30 01:09:41.008236 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:09:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:41.461003 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-6cc89328-b8ab-40d4-b69a-849ad62dd1d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "disk": 160, "id": "5", "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:41.466821 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:41.482122 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-6cc89328-b8ab-40d4-b69a-849ad62dd1d8 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.466200 Aug 30 01:09:41.484054 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1283 bytes} [Tue Aug 30 01:09:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:09:41.495985 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-e0a88637-5220-4e8a-b3a0-fc26199b88ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:41.523876 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-e0a88637-5220-4e8a-b3a0-fc26199b88ba admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032728 Aug 30 01:09:41.524523 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1333 bytes} [Tue Aug 30 01:09:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:59.691197 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-6cc89328-b8ab-40d4-b69a-849ad62dd1d8 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:59.692245 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-6cc89328-b8ab-40d4-b69a-849ad62dd1d8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 30 01:09:59.692641 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:09:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:59.703454 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG dbcounter [-] [105684] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:00.085309 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-6981b33c-1371-43eb-a620-79efbdeb9a60 admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:00.105723 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-6981b33c-1371-43eb-a620-79efbdeb9a60 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406832 Aug 30 01:10:00.106256 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1292 bytes} [Tue Aug 30 01:09:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:01.170206 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-6cc89328-b8ab-40d4-b69a-849ad62dd1d8 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:01.171265 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-6cc89328-b8ab-40d4-b69a-849ad62dd1d8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 30 01:10:01.171663 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Aug 30 01:10:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:01.704764 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-fa469607-884e-484f-a1f0-202b39680b66 admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:01.710616 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.wsgi [None req-fa469607-884e-484f-a1f0-202b39680b66 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-fa469607-884e-484f-a1f0-202b39680b66 admin admin] Request method failure captured: Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Accept: application/json Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Accept-Encoding: gzip, deflate Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Connection: keep-alive Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Content-Length: 0 Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Host: 10.222.0.44 Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Openstack-Api-Version: compute 2.90 Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Openstack-System-Scope: None Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: User-Agent: python-novaclient Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Auth-Token: gAAAAABjDWNpTPRvDYsEEQBqiaGJP2V68Q0dwoPWRnpHiyqkQFX6uHWqcMkMoY5Pt74H-cMMLs82SpxQu3Z8i_MBZT_jayNBw9To4skc0VP3E1-e_cuHiSUaZyMJHLoVSfQFz4HRmlTWRnZYAcBtandEbpg-EYpTworxLjJw6x2llNqSHs7q_50 Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Domain-Id: None Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Domain-Name: None Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Identity-Status: Confirmed Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Is-Admin-Project: True Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Project-Domain-Id: default Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Project-Domain-Name: Default Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Project-Id: 236d122dbb6b4283a260bcccbdcd4a4a Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Project-Name: admin Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Role: reader,member,admin Aug 30 01:10:01.713924 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Roles: reader,member,admin Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Tenant: admin Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Tenant-Id: 236d122dbb6b4283a260bcccbdcd4a4a Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Tenant-Name: admin Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User: admin Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User-Domain-Id: default Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User-Domain-Name: Default Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User-Id: 56560cd65ed74a0a9e8aff03655fb0e8 Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User-Name: admin Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: method: > Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: exception: Flavor 42 could not be found. Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: action_args: {'id': '42'} Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:10:01.715760 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:01.716942 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:01.718910 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-fa469607-884e-484f-a1f0-202b39680b66 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:10:01.720696 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-fa469607-884e-484f-a1f0-202b39680b66 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.405069 Aug 30 01:10:01.720696 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Aug 30 01:10:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:01.726657 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-f386be73-6811-4a10-a8fe-7b4d223a0053 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:01.751271 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-f386be73-6811-4a10-a8fe-7b4d223a0053 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028919 Aug 30 01:10:01.751816 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Aug 30 01:10:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:01.761986 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-b840dc43-379c-49af-a35a-cd67812cca1e admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:01.799815 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-b840dc43-379c-49af-a35a-cd67812cca1e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.041691 Aug 30 01:10:01.800395 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Aug 30 01:10:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:01.810416 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-d5dc55e7-4159-4abd-8837-df19984e2d30 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:01.816003 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.wsgi [None req-d5dc55e7-4159-4abd-8837-df19984e2d30 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-d5dc55e7-4159-4abd-8837-df19984e2d30 admin admin] Request method failure captured: Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Accept: application/json Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Accept-Encoding: gzip, deflate Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Connection: keep-alive Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Content-Length: 0 Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Host: 10.222.0.44 Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Openstack-Api-Version: compute 2.90 Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Openstack-System-Scope: None Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: User-Agent: python-novaclient Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Auth-Token: gAAAAABjDWNpTPRvDYsEEQBqiaGJP2V68Q0dwoPWRnpHiyqkQFX6uHWqcMkMoY5Pt74H-cMMLs82SpxQu3Z8i_MBZT_jayNBw9To4skc0VP3E1-e_cuHiSUaZyMJHLoVSfQFz4HRmlTWRnZYAcBtandEbpg-EYpTworxLjJw6x2llNqSHs7q_50 Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Domain-Id: None Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Domain-Name: None Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Identity-Status: Confirmed Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Is-Admin-Project: True Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Project-Domain-Id: default Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Project-Domain-Name: Default Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Project-Id: 236d122dbb6b4283a260bcccbdcd4a4a Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Project-Name: admin Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Role: reader,member,admin Aug 30 01:10:01.819213 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Roles: reader,member,admin Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Tenant: admin Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Tenant-Id: 236d122dbb6b4283a260bcccbdcd4a4a Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Tenant-Name: admin Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User: admin Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User-Domain-Id: default Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User-Domain-Name: Default Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User-Id: 56560cd65ed74a0a9e8aff03655fb0e8 Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User-Name: admin Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: method: > Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: exception: Flavor 42 could not be found. Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: action_args: {'id': '42'} Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:10:01.820811 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:01.821752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:01.822966 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-d5dc55e7-4159-4abd-8837-df19984e2d30 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:10:01.824246 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-d5dc55e7-4159-4abd-8837-df19984e2d30 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014343 Aug 30 01:10:01.824246 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Aug 30 01:10:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:02.809276 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-b840dc43-379c-49af-a35a-cd67812cca1e admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:02.810394 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-b840dc43-379c-49af-a35a-cd67812cca1e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Aug 30 01:10:02.810877 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Aug 30 01:10:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:03.348679 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-2b1f3296-fe7d-45d8-8472-7176caaafa56 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:03.355316 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.wsgi [None req-2b1f3296-fe7d-45d8-8472-7176caaafa56 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-2b1f3296-fe7d-45d8-8472-7176caaafa56 admin admin] Request method failure captured: Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Accept: application/json Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Accept-Encoding: gzip, deflate Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Connection: keep-alive Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Content-Length: 0 Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Host: 10.222.0.44 Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Openstack-Api-Version: compute 2.90 Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Openstack-System-Scope: None Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: User-Agent: python-novaclient Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Auth-Token: gAAAAABjDWNqJouqLNE5cMdeNp4eMHwTYxKRgIJLM-AVXBsUo28fJ_w_KTuouwDt0zORNswFkmHmAIXXJFo8zDw3N1xvOtVtGMEu9GRWlfBDfi6EXJln7JozlL_jxRcNeNLrD_a6uYoPlBMsqUfJ766dCKA0__MkcJv6rolcfC-EZAfHg5lntwQ Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Domain-Id: None Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Domain-Name: None Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Identity-Status: Confirmed Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Is-Admin-Project: True Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Project-Domain-Id: default Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Project-Domain-Name: Default Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Project-Id: 236d122dbb6b4283a260bcccbdcd4a4a Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Project-Name: admin Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Role: reader,member,admin Aug 30 01:10:03.356868 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Roles: reader,member,admin Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Tenant: admin Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Tenant-Id: 236d122dbb6b4283a260bcccbdcd4a4a Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Tenant-Name: admin Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User: admin Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User-Domain-Id: default Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User-Domain-Name: Default Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User-Id: 56560cd65ed74a0a9e8aff03655fb0e8 Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User-Name: admin Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: method: > Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: exception: Flavor 84 could not be found. Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: action_args: {'id': '84'} Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:10:03.358370 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:03.359244 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.360655 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-2b1f3296-fe7d-45d8-8472-7176caaafa56 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:10:03.362136 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-2b1f3296-fe7d-45d8-8472-7176caaafa56 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.405121 Aug 30 01:10:03.362136 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Aug 30 01:10:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:03.368050 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-45c491e1-f787-41ab-bbb4-25b8f472b1c9 admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:03.384237 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-45c491e1-f787-41ab-bbb4-25b8f472b1c9 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019771 Aug 30 01:10:03.384803 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Aug 30 01:10:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:03.394814 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-724fd2a8-7145-4c99-a56d-ce94ebb3c8e5 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:03.410013 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-724fd2a8-7145-4c99-a56d-ce94ebb3c8e5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018682 Aug 30 01:10:03.410544 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Aug 30 01:10:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:03.420506 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-8ac31aac-1081-44ad-97e1-019546759f3b admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:03.425895 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.wsgi [None req-8ac31aac-1081-44ad-97e1-019546759f3b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-8ac31aac-1081-44ad-97e1-019546759f3b admin admin] Request method failure captured: Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Accept: application/json Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Accept-Encoding: gzip, deflate Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Connection: keep-alive Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Content-Length: 0 Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Host: 10.222.0.44 Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Openstack-Api-Version: compute 2.90 Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Openstack-System-Scope: None Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: User-Agent: python-novaclient Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Auth-Token: gAAAAABjDWNqJouqLNE5cMdeNp4eMHwTYxKRgIJLM-AVXBsUo28fJ_w_KTuouwDt0zORNswFkmHmAIXXJFo8zDw3N1xvOtVtGMEu9GRWlfBDfi6EXJln7JozlL_jxRcNeNLrD_a6uYoPlBMsqUfJ766dCKA0__MkcJv6rolcfC-EZAfHg5lntwQ Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Domain-Id: None Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Domain-Name: None Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Identity-Status: Confirmed Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Is-Admin-Project: True Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Project-Domain-Id: default Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Project-Domain-Name: Default Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Project-Id: 236d122dbb6b4283a260bcccbdcd4a4a Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Project-Name: admin Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Role: reader,member,admin Aug 30 01:10:03.427421 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Roles: reader,member,admin Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Tenant: admin Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Tenant-Id: 236d122dbb6b4283a260bcccbdcd4a4a Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Tenant-Name: admin Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User: admin Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User-Domain-Id: default Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User-Domain-Name: Default Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User-Id: 56560cd65ed74a0a9e8aff03655fb0e8 Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User-Name: admin Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: method: > Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: exception: Flavor 84 could not be found. Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: action_args: {'id': '84'} Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:10:03.429046 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:03.430020 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:03.431427 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-8ac31aac-1081-44ad-97e1-019546759f3b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:10:03.433594 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-8ac31aac-1081-44ad-97e1-019546759f3b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012486 Aug 30 01:10:03.433594 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Aug 30 01:10:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:04.405068 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-724fd2a8-7145-4c99-a56d-ce94ebb3c8e5 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:04.406108 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-724fd2a8-7145-4c99-a56d-ce94ebb3c8e5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 30 01:10:04.406512 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Aug 30 01:10:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:04.935722 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-c15add65-2844-4f4d-8dbe-d98255f494f4 admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:04.941467 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.wsgi [None req-c15add65-2844-4f4d-8dbe-d98255f494f4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-c15add65-2844-4f4d-8dbe-d98255f494f4 admin admin] Request method failure captured: Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Accept: application/json Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Accept-Encoding: gzip, deflate Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Connection: keep-alive Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Content-Length: 0 Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Host: 10.222.0.44 Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Openstack-Api-Version: compute 2.90 Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Openstack-System-Scope: None Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: User-Agent: python-novaclient Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Auth-Token: gAAAAABjDWNs8qIBZiuIiPKPYFyx5ypeHcFXG-iVNMnIeCRz3gIkfiJiXJkGoa9jkbJTyfXPTRvGJMvLV_mi4cE7i02ajyQCul5h82aDV5PkYPNILRFaUPQ7swleVjmVasNZp0HF1mnOAaVWNNDQhfLA_ShoOnBknzsLd3zKAyMQdPB8xruMpfM Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Domain-Id: None Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Domain-Name: None Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Identity-Status: Confirmed Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Is-Admin-Project: True Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Project-Domain-Id: default Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Project-Domain-Name: Default Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Project-Id: 236d122dbb6b4283a260bcccbdcd4a4a Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Project-Name: admin Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Role: reader,member,admin Aug 30 01:10:04.942955 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Roles: reader,member,admin Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Tenant: admin Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Tenant-Id: 236d122dbb6b4283a260bcccbdcd4a4a Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-Tenant-Name: admin Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User: admin Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User-Domain-Id: default Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User-Domain-Name: Default Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User-Id: 56560cd65ed74a0a9e8aff03655fb0e8 Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: X-User-Name: admin Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: method: > Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: exception: Flavor 451 could not be found. Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: action_args: {'id': '451'} Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:10:04.944520 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:04.945449 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: ERROR nova.api.openstack.wsgi Aug 30 01:10:04.946795 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-c15add65-2844-4f4d-8dbe-d98255f494f4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:10:04.948054 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-c15add65-2844-4f4d-8dbe-d98255f494f4 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.398306 Aug 30 01:10:04.948054 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Aug 30 01:10:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:04.954242 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-46a7a2e5-90d4-4a21-8acc-834a89993b8c admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:04.970574 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-46a7a2e5-90d4-4a21-8acc-834a89993b8c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019877 Aug 30 01:10:04.971119 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Aug 30 01:10:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:04.981482 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:04.996543 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019512 Aug 30 01:10:04.997070 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Aug 30 01:10:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:10:05.006238 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-179c999a-b3b5-4188-a598-6d8e7c468272 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:05.011742 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.wsgi [None req-179c999a-b3b5-4188-a598-6d8e7c468272 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-179c999a-b3b5-4188-a598-6d8e7c468272 admin admin] Request method failure captured: Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Accept: application/json Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Accept-Encoding: gzip, deflate Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Connection: keep-alive Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Content-Length: 0 Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Host: 10.222.0.44 Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Openstack-Api-Version: compute 2.90 Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Openstack-System-Scope: None Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: User-Agent: python-novaclient Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Auth-Token: gAAAAABjDWNs8qIBZiuIiPKPYFyx5ypeHcFXG-iVNMnIeCRz3gIkfiJiXJkGoa9jkbJTyfXPTRvGJMvLV_mi4cE7i02ajyQCul5h82aDV5PkYPNILRFaUPQ7swleVjmVasNZp0HF1mnOAaVWNNDQhfLA_ShoOnBknzsLd3zKAyMQdPB8xruMpfM Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Domain-Id: None Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Domain-Name: None Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Identity-Status: Confirmed Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Is-Admin-Project: True Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Project-Domain-Id: default Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Project-Domain-Name: Default Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Project-Id: 236d122dbb6b4283a260bcccbdcd4a4a Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Project-Name: admin Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Role: reader,member,admin Aug 30 01:10:05.013268 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Roles: reader,member,admin Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_236d122dbb6b4283a260bcccbdcd4a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Tenant: admin Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Tenant-Id: 236d122dbb6b4283a260bcccbdcd4a4a Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-Tenant-Name: admin Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User: admin Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User-Domain-Id: default Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User-Domain-Name: Default Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User-Id: 56560cd65ed74a0a9e8aff03655fb0e8 Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: X-User-Name: admin Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: method: > Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: exception: Flavor 451 could not be found. Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: action_args: {'id': '451'} Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:10:05.014772 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:05.015716 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: ERROR nova.api.openstack.wsgi Aug 30 01:10:05.016982 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-179c999a-b3b5-4188-a598-6d8e7c468272 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:10:05.018297 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-179c999a-b3b5-4188-a598-6d8e7c468272 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011892 Aug 30 01:10:05.018297 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Aug 30 01:10:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 01:10:05.993190 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:05.994198 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 30 01:10:05.994593 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Aug 30 01:10:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:06.527130 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-baa946db-299f-425d-8d86-c609f4675616 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:06.546528 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-baa946db-299f-425d-8d86-c609f4675616 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.410322 Aug 30 01:10:06.547069 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Aug 30 01:10:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:10:07.527965 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:07.529008 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 30 01:10:07.529406 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Aug 30 01:10:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:08.097542 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-30ab367f-18cf-4e55-9dec-717760ee5943 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:08.116769 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-30ab367f-18cf-4e55-9dec-717760ee5943 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.444582 Aug 30 01:10:08.117883 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Aug 30 01:10:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:10:09.128092 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:09.129087 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 30 01:10:09.129494 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Aug 30 01:10:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:09.715749 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-a5b1cf8d-14ae-4cc5-8c5a-5b7cce1450d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:09.735504 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-a5b1cf8d-14ae-4cc5-8c5a-5b7cce1450d3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.445675 Aug 30 01:10:09.736067 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Aug 30 01:10:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:10:10.754972 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:10.756024 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 30 01:10:10.756448 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Aug 30 01:10:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:11.300308 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-2a6c1bb3-9761-4f16-9b2a-d0412e368a6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:11.318678 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-2a6c1bb3-9761-4f16-9b2a-d0412e368a6e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.421586 Aug 30 01:10:11.319229 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Aug 30 01:10:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:10:12.330729 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:12.331734 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 30 01:10:12.332335 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Aug 30 01:10:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:10:12.912844 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-ca2a731f-c2d5-4f8e-8597-7b42feea4923 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:12.936777 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-ca2a731f-c2d5-4f8e-8597-7b42feea4923 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.460977 Aug 30 01:10:12.937332 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Tue Aug 30 01:10:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:07.590840 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:07.591757 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-afb84e86-b55b-46ef-969f-4d88425f9a6f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 30 01:11:07.592193 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 931 bytes} [Tue Aug 30 01:11:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:11:07.603125 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:07.992879 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-2008635f-6e5a-4816-b01e-75019fd8db91 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:08.013804 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-2008635f-6e5a-4816-b01e-75019fd8db91 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415243 Aug 30 01:11:08.014353 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1292 bytes} [Tue Aug 30 01:11:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:08.036126 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG dbcounter [-] [105684] Writing DB stats nova_api:SELECT=14 {{(pid=105684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:08.039865 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-667b70b9-260a-4bfc-8794-518c6c37658b admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:08.047499 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-667b70b9-260a-4bfc-8794-518c6c37658b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012797 Aug 30 01:11:08.048041 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1283 bytes} [Tue Aug 30 01:11:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:08.059953 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-7fbaf5a0-95b9-4e19-91bb-86289b246dd8 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:08.067637 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-7fbaf5a0-95b9-4e19-91bb-86289b246dd8 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011391 Aug 30 01:11:08.068191 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1286 bytes} [Tue Aug 30 01:11:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:08.080491 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-0d48b20a-68d7-462c-b626-43e388e7fb7c admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:08.088091 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-0d48b20a-68d7-462c-b626-43e388e7fb7c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011154 Aug 30 01:11:08.088637 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1286 bytes} [Tue Aug 30 01:11:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:08.100920 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-4d12407d-3274-4a8e-adb3-26be4c87024d admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:08.109775 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-4d12407d-3274-4a8e-adb3-26be4c87024d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012241 Aug 30 01:11:08.110551 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1283 bytes} [Tue Aug 30 01:11:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:19.772350 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-0d48b20a-68d7-462c-b626-43e388e7fb7c admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:19.773622 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-0d48b20a-68d7-462c-b626-43e388e7fb7c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001792 Aug 30 01:14:19.774033 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Aug 30 01:14:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:14:20.031550 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writing DB stats nova_api:SELECT=6 {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:20.249687 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-67cba188-dcd5-4dbb-bf50-07aba167d2c7 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:20.253639 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-67cba188-dcd5-4dbb-bf50-07aba167d2c7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:20.254771 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-67cba188-dcd5-4dbb-bf50-07aba167d2c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:20.255261 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-67cba188-dcd5-4dbb-bf50-07aba167d2c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:20.256076 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-67cba188-dcd5-4dbb-bf50-07aba167d2c7 admin admin] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:20.256569 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-67cba188-dcd5-4dbb-bf50-07aba167d2c7 admin admin] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:20.257088 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-67cba188-dcd5-4dbb-bf50-07aba167d2c7 admin admin] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:20.294237 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-67cba188-dcd5-4dbb-bf50-07aba167d2c7 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.264210 Aug 30 01:14:20.294753 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Aug 30 01:14:20 2022] GET /compute/v2.1/os-services => generated 794 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:14:21.228666 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-0d48b20a-68d7-462c-b626-43e388e7fb7c admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:21.230191 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-0d48b20a-68d7-462c-b626-43e388e7fb7c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002308 Aug 30 01:14:21.230837 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Aug 30 01:14:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:14:21.556466 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-337e895a-a31c-462c-b461-12a612c22319 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:21.560844 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-337e895a-a31c-462c-b461-12a612c22319 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:21.561334 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-337e895a-a31c-462c-b461-12a612c22319 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:21.561758 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-337e895a-a31c-462c-b461-12a612c22319 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:21.562476 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-337e895a-a31c-462c-b461-12a612c22319 admin admin] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:21.562920 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-337e895a-a31c-462c-b461-12a612c22319 admin admin] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:21.563338 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-337e895a-a31c-462c-b461-12a612c22319 admin admin] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:21.586694 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-337e895a-a31c-462c-b461-12a612c22319 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.098584 Aug 30 01:14:21.587278 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Aug 30 01:14:21 2022] GET /compute/v2.1/os-services => generated 794 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:14:32.916372 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-0d48b20a-68d7-462c-b626-43e388e7fb7c admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:32.917445 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-0d48b20a-68d7-462c-b626-43e388e7fb7c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Aug 30 01:14:32.917961 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Aug 30 01:14:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:14:33.065989 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writing DB stats nova_cell0:SELECT=4 {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:33.066739 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writing DB stats nova_cell1:SELECT=4 {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:33.067462 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG dbcounter [-] [105683] Writing DB stats nova_api:SELECT=8 {{(pid=105683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:33.145209 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-867f0731-2a48-4a24-8e03-99fb4eb0fe18 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:33.151752 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-867f0731-2a48-4a24-8e03-99fb4eb0fe18 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:33.152660 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-867f0731-2a48-4a24-8e03-99fb4eb0fe18 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:33.153774 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-867f0731-2a48-4a24-8e03-99fb4eb0fe18 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:33.155105 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-867f0731-2a48-4a24-8e03-99fb4eb0fe18 admin admin] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:33.155911 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-867f0731-2a48-4a24-8e03-99fb4eb0fe18 admin admin] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:33.156702 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-867f0731-2a48-4a24-8e03-99fb4eb0fe18 admin admin] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:33.205857 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-867f0731-2a48-4a24-8e03-99fb4eb0fe18 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.145610 Aug 30 01:14:33.207321 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Aug 30 01:14:33 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:14:34.091945 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: DEBUG nova.api.openstack.wsgi [None req-0d48b20a-68d7-462c-b626-43e388e7fb7c admin admin] Calling method '>' {{(pid=105684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:34.093748 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: INFO nova.api.openstack.requestlog [None req-0d48b20a-68d7-462c-b626-43e388e7fb7c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002536 Aug 30 01:14:34.094476 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: [pid: 105684|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Aug 30 01:14:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:14:34.429021 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG nova.api.openstack.wsgi [None req-f45e60be-36a2-4842-9b3c-9b570c5cb0c8 admin admin] Calling method '>' {{(pid=105683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:34.432922 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-f45e60be-36a2-4842-9b3c-9b570c5cb0c8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:34.433402 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-f45e60be-36a2-4842-9b3c-9b570c5cb0c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:34.433831 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-f45e60be-36a2-4842-9b3c-9b570c5cb0c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:34.434550 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-f45e60be-36a2-4842-9b3c-9b570c5cb0c8 admin admin] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:34.434994 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-f45e60be-36a2-4842-9b3c-9b570c5cb0c8 admin admin] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:34.435407 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: DEBUG oslo_concurrency.lockutils [None req-f45e60be-36a2-4842-9b3c-9b570c5cb0c8 admin admin] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:34.461879 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: INFO nova.api.openstack.requestlog [None req-f45e60be-36a2-4842-9b3c-9b570c5cb0c8 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.103020 Aug 30 01:14:34.462466 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: [pid: 105683|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Aug 30 01:14:34 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:33.354259 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: Tue Aug 30 01:15:33 2022 - graceful shutdown triggered... Aug 30 01:15:33.355058 dv-cinder-815145-12-iscsi devstack@n-api.service[105683]: Gracefully killing worker 1 (pid: 105683)... Aug 30 01:15:33.354500 dv-cinder-815145-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 01:15:33.356291 dv-cinder-815145-12-iscsi devstack@n-api.service[105684]: Gracefully killing worker 2 (pid: 105684)... Aug 30 01:15:34.355045 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: worker 1 buried after 1 seconds Aug 30 01:15:34.355045 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: worker 2 buried after 1 seconds Aug 30 01:15:34.355045 dv-cinder-815145-12-iscsi devstack@n-api.service[105682]: goodbye to uWSGI. Aug 30 01:15:34.356876 dv-cinder-815145-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 01:15:34.357819 dv-cinder-815145-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 01:15:34.362091 dv-cinder-815145-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 01:15:34.381436 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 01:15:34.384564 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 01:15:34 2022] *** Aug 30 01:15:34.384564 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 01:15:34.384564 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 01:15:34.384564 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: nodename: dv-cinder-815145-12-iscsi Aug 30 01:15:34.384564 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: machine: x86_64 Aug 30 01:15:34.384564 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: clock source: unix Aug 30 01:15:34.384564 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: pcre jit disabled Aug 30 01:15:34.384564 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: detected number of CPU cores: 4 Aug 30 01:15:34.384564 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: current working directory: / Aug 30 01:15:34.384564 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: detected binary path: /usr/bin/uwsgi-core Aug 30 01:15:34.385738 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: your processes number limit is 47680 Aug 30 01:15:34.385738 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: your memory page size is 4096 bytes Aug 30 01:15:34.385738 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: detected max file descriptor number: 2048 Aug 30 01:15:34.385738 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: lock engine: pthread robust mutexes Aug 30 01:15:34.385738 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: thunder lock: enabled Aug 30 01:15:34.385738 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 01:15:34.385738 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 01:15:34.432876 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: Python main interpreter initialized at 0x560186b149c0 Aug 30 01:15:34.432876 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: python threads support enabled Aug 30 01:15:34.432876 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: your server socket listen backlog is limited to 100 connections Aug 30 01:15:34.432876 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: your mercy for graceful operations on workers is 90 seconds Aug 30 01:15:34.433468 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 01:15:34.433468 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: *** Operational MODE: preforking *** Aug 30 01:15:34.433687 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: *** uWSGI is running in multiple interpreter mode *** Aug 30 01:15:34.433687 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: spawned uWSGI master process (pid: 120691) Aug 30 01:15:34.433893 dv-cinder-815145-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 01:15:34.437169 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: spawned uWSGI worker 1 (pid: 120705, cores: 1) Aug 30 01:15:34.440288 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: spawned uWSGI worker 2 (pid: 120706, cores: 1) Aug 30 01:15:34.440771 dv-cinder-815145-12-iscsi devstack@n-api.service[120691]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 01:15:35.152421 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:15:35.209908 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:15:36.393148 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:15:36.393148 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: from cryptography.utils import int_from_bytes Aug 30 01:15:36.394218 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:15:36.394218 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: from cryptography.utils import int_from_bytes Aug 30 01:15:36.626750 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:15:36.626750 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: from cryptography.utils import int_from_bytes Aug 30 01:15:36.627472 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:15:36.627472 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: from cryptography.utils import int_from_bytes Aug 30 01:15:40.222210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:15:40.223037 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:15:40.223482 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:15:40.223986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:15:40.224461 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:15:40.225118 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.225633 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.226170 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.226730 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.227450 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.228043 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.228587 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.229146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.229823 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.230226 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.230739 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.231181 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815145-12-iscsi {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.231630 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.232127 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.233155 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.233594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.234144 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.234699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.235174 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.235852 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.236499 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.237037 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.237812 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.238416 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.238993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.239521 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.240601 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.241336 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.242315 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.242583 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.243070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815145-12-iscsi {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.243530 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.243982 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.245198 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.245948 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.246524 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.247028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.247646 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.249339 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.250247 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.250883 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.251452 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.252099 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.252672 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.253852 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.253852 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.254321 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.255115 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.255903 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.256477 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.256916 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.257466 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.258067 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.258615 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.259305 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.259964 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.261412 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.262244 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.262805 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.264340 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.264886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.265580 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.266127 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.266830 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.267224 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.267687 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.268189 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.268607 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.269159 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.271123 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.271698 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.272303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.272894 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.273331 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.273930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.274617 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.275251 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.275901 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.276553 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.277195 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.277767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.278362 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.278913 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.280413 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.281115 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.282210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.282210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.282491 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.282979 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.283555 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.284150 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.284684 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.285237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.285764 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.286311 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.286851 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.287461 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.288144 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.288727 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.289283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.289868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.290519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.291142 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.291958 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.292812 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.293412 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.293976 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.294600 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.295789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.296448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.296932 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.297414 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.298612 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.298612 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.298988 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.299542 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.300116 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.300680 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.301227 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.301867 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.302364 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.302917 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.306448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.306448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.306448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.306448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.306448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.306448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.307386 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.307386 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.307681 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.308237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.308797 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.309765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.309893 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.311626 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.312329 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.312957 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.313503 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.314842 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.314842 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.314842 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.315347 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.316181 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.316734 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.317300 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.317882 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.318454 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.318990 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.319559 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.320162 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.320719 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.321331 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.321882 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.322441 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.323107 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.324390 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.324390 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.325019 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.325693 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.326718 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.327146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.327798 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.328431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.329097 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.329932 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.330285 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.330861 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.331402 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.331988 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.332612 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.333155 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.333730 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.334272 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.334952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.335417 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.336061 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.336553 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.337119 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.337641 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.338269 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.338815 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.339404 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.339951 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.340522 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.341089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.342257 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.343528 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.344123 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.344668 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.345202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.345748 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.346326 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.346858 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.347435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.348061 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.348596 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.349345 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.349690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.350300 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.350805 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.351369 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.351922 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.352551 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.353125 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.353666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.354268 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.354822 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.355373 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.355959 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.356586 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.357065 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.358163 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.358648 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.359294 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.359855 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.361051 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.361658 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.362198 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.362773 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.363395 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.364044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.364575 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.365248 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.365882 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.366391 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.366911 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.367489 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.368114 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.369293 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.369934 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.370506 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.371067 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.372051 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.372051 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.372553 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.374245 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.374864 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.375484 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.375972 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.376525 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.377059 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.377541 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.377976 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.378484 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.378940 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.379378 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.379829 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.381413 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.383915 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.383915 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.383915 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.383915 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.384524 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.385004 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.385543 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.386115 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.386697 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.387270 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.387828 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.388427 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.389629 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.390195 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.390807 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.391450 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.391920 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.392555 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.393116 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.393679 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.394260 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.395071 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.395712 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.396400 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.396931 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.397409 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.400068 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.400068 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.400068 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.400068 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.400727 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.400727 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.401312 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.402232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.402347 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.402834 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.403981 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.403981 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.405251 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.405791 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.406365 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.406885 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.407430 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.407987 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.408602 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.409162 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.409734 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.410271 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.410838 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.411392 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.411946 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.413045 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.413045 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.413651 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.414228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.414804 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.415381 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.415911 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.416477 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.417054 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.417601 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.418164 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.418719 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.419258 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.421001 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.421572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.422129 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.422722 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.423298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.423850 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.424447 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.425077 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.425600 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.426188 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.427610 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.427610 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.428151 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.428151 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.428619 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.428890 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.429205 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.429992 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.430229 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.430788 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.432083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.432083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.432551 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.433441 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.434026 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.434590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.435406 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.435903 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.436568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.437212 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.437792 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.438338 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.439924 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.439924 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.439924 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.440719 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.440719 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.441293 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.441656 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.442252 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.443462 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.443462 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.443954 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.444523 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.445014 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.445580 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.446107 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.446684 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.447294 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.447945 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.448643 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.449168 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.449733 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.450201 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.450717 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.451478 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.451952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.456089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.456089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.456089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.456089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.456089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.456903 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.456903 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.457427 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.458030 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.458499 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.458918 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.459424 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.459862 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.461429 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.461843 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.462394 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.462969 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.463508 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.464146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.464700 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.465652 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.465652 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.466151 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.467294 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.467766 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.468294 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.468731 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.469305 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.469859 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.470396 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.470947 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.471787 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.472066 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.472584 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.473179 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.473740 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.474288 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.474832 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.475383 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.475725 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.476095 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.476435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.476990 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.477544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.478082 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.478700 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.479331 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.479961 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.480620 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.481232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.481765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.483150 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.483711 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.484301 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.484850 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.485428 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.485978 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.486726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.487045 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.487601 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.488258 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.488805 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.489424 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.490061 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.490594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.491298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.492190 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.492582 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.493340 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.493854 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.494436 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.495045 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.495689 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.496304 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.496890 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.497480 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.498038 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.498519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.499006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.499483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.499967 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.501445 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.501998 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.502574 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.503127 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.503668 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.504308 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.504866 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.505277 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.505721 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.506155 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.506593 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.507075 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.507539 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.508446 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.509074 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.509735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.510348 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.510893 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.511456 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.512043 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.512633 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.513012 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.514010 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.514565 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.515063 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.515450 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.515793 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.516271 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.516717 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.517152 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.517596 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.518213 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.518765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.519303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.520136 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.520700 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.521454 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.521849 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.522441 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.522971 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.523516 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.524081 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.524660 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.525224 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.525859 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.526625 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.527177 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.528066 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.528420 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.528980 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.530473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.533370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.533370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.533370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.533370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.533370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.534132 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.534293 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.534749 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.535259 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.535756 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.536309 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.536895 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.537341 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.537686 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.538034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.538496 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.538846 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.539180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.539524 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.539869 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.540964 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.541529 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.542081 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.542615 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.543158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.543626 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.547374 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.547374 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.547374 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.547374 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.548078 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.551768 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.551768 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.551768 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.551768 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.551768 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.552693 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.553004 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.553557 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.554122 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.554693 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.555237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.555789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.556361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.556972 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.560030 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.560030 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.560030 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.560030 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.560030 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.561924 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.561924 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.562405 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.562943 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.563401 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.563834 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.564319 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.565632 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.565632 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.565969 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.568732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.568732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.568732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.568732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.568732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.569446 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.572044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.572044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.572044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.572044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.572044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.572827 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.573001 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.573517 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.574102 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.574661 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.575216 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.575767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.577135 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.578146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.578264 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.578716 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.579089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.579432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.579768 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.581752 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.582382 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.582960 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.583929 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.584977 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.585468 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.586050 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.586584 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.587161 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.587745 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.588293 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.588829 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.589351 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.589846 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.590318 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.590765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.591281 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.591853 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.593431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.593934 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.594421 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.594945 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.595549 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.596120 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.597036 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.597237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.597812 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.598374 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.598808 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.599270 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.599771 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.600322 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.600754 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.601761 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.601761 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.602308 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.602759 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.603214 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.603649 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.604122 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.604691 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.605256 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.606241 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.606790 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.607415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.607907 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.609091 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.609564 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.610105 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.610830 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.611175 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.612044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.612257 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.612827 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.613377 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.613956 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.614501 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.615060 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.615624 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.616240 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.617406 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.618026 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.618569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.619151 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.619721 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.620323 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.620846 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.621331 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.621793 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.622245 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.622778 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.623715 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.624152 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.624544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.627868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.627868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.627868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.627868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.627868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.627868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.627868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.627868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.629187 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.629187 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.629187 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.629187 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.629187 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.629811 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.629811 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.630098 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.630244 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.630550 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.630873 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.631190 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.631511 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.631872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.632251 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.632577 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.632889 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.633226 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.633551 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.633885 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.634209 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.634530 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.634900 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.635223 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.635847 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.636224 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.637030 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.637030 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.637382 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.637554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.637831 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.640655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.640655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.640655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.640655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.640655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.640655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.640655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.641219 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.641219 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.641561 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.641859 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.642178 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.642504 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.642812 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.643127 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.643603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.643764 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.644154 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.644741 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.645066 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.645393 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.646848 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.647180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.647508 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.647833 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.648185 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.648518 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.648887 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.649819 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.649819 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.650142 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.650302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.650599 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.650930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.651249 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.651590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.651929 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.652843 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.653186 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.653511 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.653866 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.654252 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.654599 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.654935 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.655285 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.655602 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.655920 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.656529 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.656865 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.657190 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.657506 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.657823 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.658142 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.658457 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.658774 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.659086 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.661330 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.661330 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.661330 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.661330 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.661330 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.661330 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.661330 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.661894 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.661894 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.662132 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.662467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.662755 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.663063 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.663375 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.663725 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.664093 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.664417 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.664750 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.665070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.665419 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.665729 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.666067 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.668497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.668497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.668497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.668497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.668497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.668939 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.669017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.669345 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.669661 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.670550 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.670909 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.671198 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.671520 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.671861 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.672232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.672605 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.672937 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.673263 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.673603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.673925 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.674246 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.674564 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.674881 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.675199 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.675638 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.675872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.676751 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.677083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.677414 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.677761 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.678097 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.678420 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.678753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.679368 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.679521 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.679760 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.680321 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.681240 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.681715 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.682350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.682997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.684854 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:15:40.742477 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:15:40.743131 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:15:40.743306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:15:40.743655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:15:40.743909 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:15:40.744342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.744664 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.745000 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.745326 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.745666 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.746034 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.746366 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.747525 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.747525 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.747525 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.748523 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.748523 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815145-12-iscsi {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.749496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.749827 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.750152 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.750489 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.750846 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.751181 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.752326 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.752326 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.752630 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.752764 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.753034 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.753383 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.753709 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.754025 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.754353 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.754666 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.755001 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.755318 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.755731 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815145-12-iscsi {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.756583 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.756913 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.757333 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.757669 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.757987 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.758305 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.758633 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.759791 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.759791 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.759791 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.760580 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.760580 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.760580 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.761262 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.761262 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.761717 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.761941 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.762176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.762412 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.762642 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.762968 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.763305 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.764309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.765449 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.765707 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.765941 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.766181 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.766508 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.766830 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.767148 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.767474 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.767785 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.768284 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.768607 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.768920 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.769235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.769828 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.770163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.770490 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.770808 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.771137 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.771976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.771976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.773258 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.773258 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.773556 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.773884 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.774215 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.774551 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.774904 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.775183 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.775493 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.775822 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.776485 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.777204 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.778073 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.778490 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.778966 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.780235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.780940 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.781466 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.781975 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.782558 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.783072 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.783618 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.784205 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.784778 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.785337 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.785785 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.786188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.786592 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.786991 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.787433 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.787885 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.788361 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.788693 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.790826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.790826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.790826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.790826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.790826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.790826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.791348 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.791348 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.791563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.791885 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.792244 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.792584 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.792902 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.793383 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.793886 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.794368 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.794895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.795716 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.795915 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.796231 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.796557 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.796878 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.797199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.797518 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.797928 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.799180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.799180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.799180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.799180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.799489 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:40.799787 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.800162 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.800712 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.801074 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.801387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.801743 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.802062 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.802391 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.802777 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.803221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.803376 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.803700 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.804226 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.804793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.805131 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.805480 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.805845 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.806178 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.806511 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.806836 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.807167 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.807511 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.807915 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.808186 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.808539 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.809071 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.809405 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.809746 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.810084 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.810491 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.810920 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.811494 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.811494 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.813740 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.813740 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.813740 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.813740 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.813740 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.813740 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.813740 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.814328 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.814328 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.814586 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.814938 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.815265 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.817400 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.817400 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.817400 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.817400 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.817400 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.817400 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.817889 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.817889 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.818148 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.818472 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.818794 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.819109 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.819443 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.819783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.820123 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.820469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.820785 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.820883 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO dbcounter [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] Registered counter for database nova_api Aug 30 01:15:40.821108 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.821429 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.821750 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.822072 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.822402 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.822723 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.823039 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.823450 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.823739 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.824144 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.825331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.825331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.825331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.825331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.826698 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.826698 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.826987 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.827137 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.827631 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.827965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.828722 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.828722 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.829016 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.829458 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.829657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.829993 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.830332 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.830644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.830970 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.831288 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.831616 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.831909 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.832257 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.832572 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.832887 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.833200 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.833512 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.833927 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.834643 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.834643 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.834939 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.835085 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.835382 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.836093 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.836318 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.836680 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.837032 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.837415 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.837711 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.838022 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.838346 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.838665 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.838986 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.839310 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.839635 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.839954 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.840887 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.841227 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.841562 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.842491 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.842971 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.843410 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.844756 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.848186 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.848858 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.849023 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_db.sqlalchemy.engines [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:15:40.849228 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.849723 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.850256 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.850586 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.850932 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.851426 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.852094 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.852405 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.852638 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.852986 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.853321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.853667 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.853995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.855432 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.855432 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.855432 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.855432 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.855786 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.855974 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.856387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.856841 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.857044 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.857411 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.858350 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.858470 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.858825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.859154 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.859476 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.859805 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.860193 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.860521 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.860848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.861172 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.861502 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.861964 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writer thread running {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:15:40.862145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.862413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.862636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.863466 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.863466 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.863680 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.863948 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.864367 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.864683 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.865002 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.865343 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.865670 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.865988 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.866307 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.866630 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.866993 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.867319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.867640 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.868098 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.868372 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.868699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.869029 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.869353 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.869678 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.870020 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.870348 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.870668 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.870990 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.871836 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.871836 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.872036 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.872301 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.872650 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.873014 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.873340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.873659 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.873998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.874320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.875257 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.875257 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.875593 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.876051 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.876271 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.876630 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.876978 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.880048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.880048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.880048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.880048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.880048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.880048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.880048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.880048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.880675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.880675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.880675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.880872 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.881095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.881413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.881728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.882059 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.882377 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.882704 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.883021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.883365 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.883687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.884029 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.884419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.884734 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.885242 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.885408 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.885764 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.886107 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.886463 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.886779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.887098 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.887434 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.887910 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.888090 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.888408 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.889381 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.889994 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.889994 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.890285 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.890605 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.890929 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.891282 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.891596 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.891919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.892266 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.892596 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.892918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.893235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.893552 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.895467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.895467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.895467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.895467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.895467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.895876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.896233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.896352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.896649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.896977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.897383 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.897607 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.898048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.898375 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.898690 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.899006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.899325 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.899643 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.899957 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.900307 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.900643 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.900973 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.901290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.901612 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.901928 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.902244 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.902563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.902879 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.903194 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.903509 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.903833 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.904258 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.905655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.905655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.905836 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.906063 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.906309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.906623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.906982 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.907299 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.907671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.908012 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.908343 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.908674 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.909000 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.909322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.909647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.909960 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.910285 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.910610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.910929 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.911244 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.911558 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.911891 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.912241 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.912561 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.912896 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.913232 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.913571 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.913887 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.914208 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.914529 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.914849 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.915172 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.915494 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.915816 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.916245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.916568 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.916891 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.917213 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.917532 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.917855 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.918176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.918493 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.919010 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.919214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.920213 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.920213 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.920557 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.920703 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.921008 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.921475 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.921803 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.922126 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.922445 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.922768 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.923092 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.923422 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.923757 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.924284 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.924708 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.925037 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.925364 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.925690 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.926009 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.926329 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.926675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.927025 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.927307 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.927743 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.927937 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.928372 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.928693 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.929027 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.929477 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.929805 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.930123 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.930558 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.930879 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.931201 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.931539 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.931872 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.932237 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.932557 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.932884 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.933316 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.933534 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.933870 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.934195 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.934526 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.934844 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.935178 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.935697 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.936212 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.936564 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.937010 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.937352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.937679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.938017 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.938359 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.938681 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.938998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.939323 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.939640 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.939956 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.940322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.940641 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.940964 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.941286 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.941607 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.941922 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.942237 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.942572 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.942886 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.943220 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.943551 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.943885 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.944256 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.944602 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.944900 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.945220 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.945534 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.945849 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.946161 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.946656 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.946882 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.947220 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.947566 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.947905 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.948251 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.948588 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.949050 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.949255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.949585 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.949924 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.950243 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.950559 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.950880 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.951807 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.952156 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.952567 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.952896 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.953213 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.953535 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.953851 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.954193 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.954510 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.954848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.955168 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.955484 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.955800 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.956140 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.956498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.956814 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.957156 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.957476 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.957811 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.958138 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.958464 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.958791 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.959196 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.959443 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.959752 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.960103 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.960429 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.960754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.961082 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.961411 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.961992 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.962332 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.962659 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.962982 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.963311 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.963636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.963960 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.964307 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.964631 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.964963 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.965284 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.965447 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.context [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7c422da-0cce-49b5-ba78-bc23108abcf4(cell1) {{(pid=120705) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:15:40.965618 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.965949 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.966285 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.966687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.967623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.968229 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.968565 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.968887 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.969275 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.969597 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.969925 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.970255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.970428 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:40.970586 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.970875 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:40.971035 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.971199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.971513 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.971837 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.972241 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.972548 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:40.972739 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.972894 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.973188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.973437 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:40.973607 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.973849 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.974018 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:40.974187 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.974520 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.974839 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.975163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.975480 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.975975 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:40.976182 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.976406 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.976756 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.977088 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.977432 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.977755 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.978083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.978287 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO dbcounter [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] Registered counter for database nova_cell0 Aug 30 01:15:40.978457 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.978729 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.979047 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.979373 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.979691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.980239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.980392 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.980785 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.981020 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.981354 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.981671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.982317 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.982725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.983059 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.983410 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.983575 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO dbcounter [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] Registered counter for database nova_cell1 Aug 30 01:15:40.983748 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.984115 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.984439 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.984781 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.985098 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.985421 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.985754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.986077 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.986392 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.986707 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.987028 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.987348 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.987669 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.988028 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.988337 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.988675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.989020 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.989335 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.989652 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.989947 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.990268 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.990580 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.991065 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.991522 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.992064 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_db.sqlalchemy.engines [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:15:40.992255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.992746 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.993076 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.993410 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.993742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.994181 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_db.sqlalchemy.engines [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:15:40.994281 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.994555 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.994740 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.995113 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.995754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.995754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.996061 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.996391 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.996885 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.997059 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.997386 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.997914 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.998131 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.998733 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.999085 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.999351 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writer thread running {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:15:40.999451 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:40.999760 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.002130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.002130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.002130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.002130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.002130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.002130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.002130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.002674 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.002674 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.002920 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.003239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.003569 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.003893 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.004248 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.004574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.004898 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.005225 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.005570 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.005865 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.006196 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.006562 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.006894 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.007222 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.007550 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.007877 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.008232 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.008557 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.008879 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.009201 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.009529 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.009872 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.010204 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.010521 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.010969 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.011295 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.011627 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.011962 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.012312 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.012649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.012989 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.013319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.014238 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.014927 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.014927 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.015363 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.015707 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.016085 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.016409 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.016727 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.017046 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.017370 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.017703 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.018027 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.018347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.018665 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.018986 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.019301 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.019873 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.020236 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.020555 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.020874 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.021188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.021503 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.021819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.022132 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.022464 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.022759 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.023077 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.023390 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.023704 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.024051 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.024358 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.024672 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.025020 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.025365 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.025691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.026021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.026345 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.026677 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.026997 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.027328 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.027660 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.028015 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.028331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.028674 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.029112 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.029976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.030826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.030826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.031081 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.031259 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.031612 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.031948 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.032295 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.032632 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.032961 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.033290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.033613 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.033936 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.034277 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.034596 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.034917 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.035236 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.035555 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.035873 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.036230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.036552 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.036873 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.037199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.037524 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.037859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.038192 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.038510 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.038846 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.039181 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.039545 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.039865 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.040247 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.040587 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.040914 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.041232 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.041546 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:41.041806 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:15:41.107324 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO dbcounter [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] Registered counter for database nova_api Aug 30 01:15:41.128383 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_db.sqlalchemy.engines [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:15:41.136037 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writer thread running {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:15:41.152656 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writer thread running {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:15:41.165807 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO dbcounter [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] Registered counter for database nova_cell0 Aug 30 01:15:41.175470 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_db.sqlalchemy.engines [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:15:41.181805 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writer thread running {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:15:41.199962 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.context [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7c422da-0cce-49b5-ba78-bc23108abcf4(cell1) {{(pid=120706) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:15:41.204313 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:41.204816 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:41.206448 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:41.207229 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:41.207697 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:41.209787 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:41.211888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO dbcounter [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] Registered counter for database nova_cell0 Aug 30 01:15:41.218767 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO dbcounter [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] Registered counter for database nova_cell1 Aug 30 01:15:41.227359 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_db.sqlalchemy.engines [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:15:41.229001 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_db.sqlalchemy.engines [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:15:41.236348 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writer thread running {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:15:41.239140 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writer thread running {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:15:41.398490 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO dbcounter [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] Registered counter for database nova_cell0 Aug 30 01:15:41.408778 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_db.sqlalchemy.engines [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:15:41.416470 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writer thread running {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:15:41.617700 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: WARNING keystonemiddleware.auth_token [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:15:41.626801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: WARNING keystonemiddleware.auth_token [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:15:41.776061 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: WARNING keystonemiddleware.auth_token [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:15:41.784942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: WARNING keystonemiddleware.auth_token [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:15:42.108777 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: WARNING keystonemiddleware.auth_token [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:15:42.119153 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: WARNING keystonemiddleware.auth_token [None req-aeb56eb9-d5a5-4679-9eee-7f83e8682592 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:15:42.129788 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x560186b149c0 pid: 120705 (default app) Aug 30 01:15:42.261105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: WARNING keystonemiddleware.auth_token [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:15:42.267668 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: WARNING keystonemiddleware.auth_token [None req-f969fa1c-5c43-46a8-ab75-baa6e36c30d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:15:42.273424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x560186b149c0 pid: 120706 (default app) Aug 30 01:16:20.858026 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.861077 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.865805 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.868150 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:22.756966 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-67bc7aed-5508-4c16-ba0d-3d83907be352 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Action: 'create', calling method: .version_select at 0x7ff48be8dee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2108871924"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:24.328889 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:24.336684 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:24.341623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:24.352552 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:25.065666 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ebfc0ea1-7d15-45c3-a5d2-7a5d2e9cfd2c tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] Calling method '.version_select at 0x7ff48be899d0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:25.718606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-67bc7aed-5508-4c16-ba0d-3d83907be352 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.833101 Aug 30 01:16:25.724182 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Aug 30 01:16:20 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4885 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 01:16:25.739824 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f1586b68-58a6-4371-b8a7-282a499ef837 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bd06d30>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:25.961585 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ebfc0ea1-7d15-45c3-a5d2-7a5d2e9cfd2c tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/70b8feff-7bfa-4a6b-aa76-7560a0e1860a" status: 200 len: 350 microversion: 2.1 time: 1.667732 Aug 30 01:16:25.962005 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 1/2] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Aug 30 01:16:24 2022] GET /compute/v2.1/os-volumes/70b8feff-7bfa-4a6b-aa76-7560a0e1860a => generated 350 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:25.992721 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f1586b68-58a6-4371-b8a7-282a499ef837 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4" status: 200 len: 346 microversion: 2.1 time: 0.266476 Aug 30 01:16:26.002670 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Aug 30 01:16:25 2022] GET /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4 => generated 346 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:26.011800 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-eb24ad3a-5724-468f-b79f-cff45e8e44c0 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Action: 'create', calling method: .version_select at 0x7ff48bd4fc10>, body: {"snapshot": {"volume_id": "36dd1c40-a863-420b-bd92-ab90f6e131d4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1264061163"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:26.929341 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-eb24ad3a-5724-468f-b79f-cff45e8e44c0 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.924788 Aug 30 01:16:26.930889 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 2/4] 10.222.0.44 () {60 vars in 1162 bytes} [Tue Aug 30 01:16:26 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:26.947175 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fb92e98e-ef00-4015-849d-7aa54389be79 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bd29430>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:27.253400 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fb92e98e-ef00-4015-849d-7aa54389be79 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2" status: 200 len: 287 microversion: 2.1 time: 0.312243 Aug 30 01:16:27.254732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 3/5] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Aug 30 01:16:26 2022] GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2 => generated 287 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:16:27.265299 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4abe729f-2b29-4262-a38f-053cd61651af tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bd10a60>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:27.428656 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4abe729f-2b29-4262-a38f-053cd61651af tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.167075 Aug 30 01:16:27.440699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 3/6] 10.222.0.44 () {58 vars in 1140 bytes} [Tue Aug 30 01:16:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:27.446078 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-298aa6e0-4f09-48b1-8fef-5cb7dc9d5561 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bd29b80>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:27.637854 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-298aa6e0-4f09-48b1-8fef-5cb7dc9d5561 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2" status: 200 len: 287 microversion: 2.1 time: 0.199760 Aug 30 01:16:27.656302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Aug 30 01:16:27 2022] GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2 => generated 287 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:28.657540 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3e441e39-eca0-4420-bf73-a597b7089ba7 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bd23c10>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:28.754440 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3e441e39-eca0-4420-bf73-a597b7089ba7 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2" status: 200 len: 287 microversion: 2.1 time: 0.101537 Aug 30 01:16:28.755451 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Aug 30 01:16:28 2022] GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2 => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:29.786705 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8290962e-b3c4-436f-a8e8-8ee69e2b47a6 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bd06ca0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:29.946668 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8290962e-b3c4-436f-a8e8-8ee69e2b47a6 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2" status: 200 len: 287 microversion: 2.1 time: 0.171311 Aug 30 01:16:29.947819 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 5/9] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Aug 30 01:16:29 2022] GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2 => generated 287 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:30.970326 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d03d09f3-3943-451b-a78c-df3d75d31cfd tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bd2c3a0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:31.154918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d03d09f3-3943-451b-a78c-df3d75d31cfd tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2" status: 200 len: 288 microversion: 2.1 time: 0.195669 Aug 30 01:16:31.164969 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 5/10] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Aug 30 01:16:30 2022] GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2 => generated 288 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:31.180190 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-83cbaaae-4ff1-4517-8cba-cbbad1aff68c tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bd29af0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:31.551656 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-83cbaaae-4ff1-4517-8cba-cbbad1aff68c tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2" status: 202 len: 0 microversion: 2.1 time: 0.380328 Aug 30 01:16:31.558106 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 6/11] 10.222.0.44 () {58 vars in 1254 bytes} [Tue Aug 30 01:16:31 2022] DELETE /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:16:31.566282 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d7e612a6-85c5-4395-b0ac-68c93ae44a1e tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48be899d0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:31.753463 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d7e612a6-85c5-4395-b0ac-68c93ae44a1e tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2" status: 200 len: 287 microversion: 2.1 time: 0.194867 Aug 30 01:16:31.755771 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Aug 30 01:16:31 2022] GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2 => generated 287 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:32.020933 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-659e399f-cfa3-44b5-bce0-6f8019f70074 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] Calling method '.version_select at 0x7ff48bd29430>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:32.146710 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-659e399f-cfa3-44b5-bce0-6f8019f70074 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1d176fd4-8673-41ef-bde7-c56df59d514c" status: 200 len: 351 microversion: 2.1 time: 0.140508 Aug 30 01:16:32.147354 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Aug 30 01:16:32 2022] GET /compute/v2.1/os-volumes/1d176fd4-8673-41ef-bde7-c56df59d514c => generated 351 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:32.767264 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5bcac5a6-db73-496b-af11-b7bc88a12480 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bd4faf0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:32.821697 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-5bcac5a6-db73-496b-af11-b7bc88a12480 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] HTTP exception thrown: Snapshot d54178d8-997f-458d-ad47-1148973120c2 could not be found. Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5bcac5a6-db73-496b-af11-b7bc88a12480 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Request method failure captured: Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2 HTTP/1.1 Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWTkoS9WHHA_GQpJlJEtP431HMndu9aJ46h94Vgd0pkNkia2DD1LHhHJV0iYuu_T3Os15bEcJKpq_jK30rL6yUx8e8UCMyJmHppyLgvf5Bwrh-x-US2n_SN2spQ-1Ms9cjjQvxWWRu0xw0i0xXA3m0V0-FcTVaNxA6d_DOThB1GedxE Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: c64e4eccf2c14dba96cbc1d8c4ab7831 Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-274407389 Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:16:32.826866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:16:32.828180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:16:32.828180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesSnapshotsTestJSON-274407389 Aug 30 01:16:32.828180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: c64e4eccf2c14dba96cbc1d8c4ab7831 Aug 30 01:16:32.828180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-274407389 Aug 30 01:16:32.828180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesSnapshotsTestJSON-274407389-project Aug 30 01:16:32.828180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:16:32.828180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:16:32.828180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: e3352d04e04942aa87180eccc1597d52 Aug 30 01:16:32.828180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesSnapshotsTestJSON-274407389-project Aug 30 01:16:32.828180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: Aug 30 01:16:32.828180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Snapshot d54178d8-997f-458d-ad47-1148973120c2 could not be found. Aug 30 01:16:32.828180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': 'd54178d8-997f-458d-ad47-1148973120c2'} Aug 30 01:16:32.828180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d54178d8-997f-458d-ad47-1148973120c2 could not be found. (HTTP 404) (Request-ID: req-38076d38-1a2c-436e-870c-f5d710677e2b) Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:32.828965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:16:32.829866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d54178d8-997f-458d-ad47-1148973120c2 could not be found. Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 01:16:32.830824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:16:32.831779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d54178d8-997f-458d-ad47-1148973120c2 could not be found. Aug 30 01:16:32.831779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:32.831779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:32.831779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:32.831779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:32.831779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:32.831779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:32.831779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:16:32.831779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:16:32.831779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d54178d8-997f-458d-ad47-1148973120c2 could not be found. Aug 30 01:16:32.831779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:32.831779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5bcac5a6-db73-496b-af11-b7bc88a12480 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Returning 404 to user: Snapshot d54178d8-997f-458d-ad47-1148973120c2 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:32.838158 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5bcac5a6-db73-496b-af11-b7bc88a12480 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2" status: 404 len: 111 microversion: 2.1 time: 0.065351 Aug 30 01:16:32.841147 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 7/14] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Aug 30 01:16:32 2022] GET /compute/v2.1/os-snapshots/d54178d8-997f-458d-ad47-1148973120c2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:32.847224 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0a5fade5-754a-4508-bd36-1ed23f765af0 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bd291f0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:33.079524 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0a5fade5-754a-4508-bd36-1ed23f765af0 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4" status: 202 len: 0 microversion: 2.1 time: 0.235943 Aug 30 01:16:33.080094 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 8/15] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Aug 30 01:16:32 2022] DELETE /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:16:33.091698 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cbe215b1-c925-4d56-9ab1-f98819128078 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bc810d0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:33.303777 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cbe215b1-c925-4d56-9ab1-f98819128078 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4" status: 200 len: 345 microversion: 2.1 time: 0.218085 Aug 30 01:16:33.304902 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Aug 30 01:16:33 2022] GET /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4 => generated 345 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:33.966593 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-49048c4b-c7ee-4196-a81e-453508be274e tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] Calling method '.version_select at 0x7ff48bc81820>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:34.106103 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-49048c4b-c7ee-4196-a81e-453508be274e tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a6774562-1659-4e98-89c9-81652bc19c9f" status: 200 len: 351 microversion: 2.1 time: 0.146593 Aug 30 01:16:34.106987 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 9/17] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Aug 30 01:16:33 2022] GET /compute/v2.1/os-volumes/a6774562-1659-4e98-89c9-81652bc19c9f => generated 351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:34.120871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ac9f2c7b-9878-4ffd-a798-4fbdb64bdec8 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] Calling method '.version_select at 0x7ff48bc81ee0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:34.345936 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a015101d-456e-4b5a-8f27-9cf432bb7aa0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Action: 'create', calling method: .version_select at 0x7ff48bd29940>, body: {"keypair": {"name": "tempest-keypair-859645508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBkLSqnH0NosB71PSgBvH5My3eJDCDhxUA/qKy4X+Iz8F6azQUR35mf62KrosoAw/idsbkzvGTOvVVMFlD1zH1rAzOiRW/iHzwDQv2E6SI6LaZLPl79iLo4kqpxxJYWHQ=="}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:34.361126 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ac9f2c7b-9878-4ffd-a798-4fbdb64bdec8 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.245244 Aug 30 01:16:34.362111 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 10/18] 10.222.0.44 () {58 vars in 1134 bytes} [Tue Aug 30 01:16:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:16:34.367372 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ea175ba5-14ca-4c25-bb88-2ebdec6654c4 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bd2cb80>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:34.448178 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-ea175ba5-14ca-4c25-bb88-2ebdec6654c4 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] HTTP exception thrown: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ea175ba5-14ca-4c25-bb88-2ebdec6654c4 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Request method failure captured: Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4 HTTP/1.1 Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWTkoS9WHHA_GQpJlJEtP431HMndu9aJ46h94Vgd0pkNkia2DD1LHhHJV0iYuu_T3Os15bEcJKpq_jK30rL6yUx8e8UCMyJmHppyLgvf5Bwrh-x-US2n_SN2spQ-1Ms9cjjQvxWWRu0xw0i0xXA3m0V0-FcTVaNxA6d_DOThB1GedxE Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: c64e4eccf2c14dba96cbc1d8c4ab7831 Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-274407389 Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:16:34.450577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:16:34.451648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:16:34.451648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesSnapshotsTestJSON-274407389 Aug 30 01:16:34.451648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: c64e4eccf2c14dba96cbc1d8c4ab7831 Aug 30 01:16:34.451648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-274407389 Aug 30 01:16:34.451648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesSnapshotsTestJSON-274407389-project Aug 30 01:16:34.451648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:16:34.451648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:16:34.451648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: e3352d04e04942aa87180eccc1597d52 Aug 30 01:16:34.451648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesSnapshotsTestJSON-274407389-project Aug 30 01:16:34.451648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: Aug 30 01:16:34.451648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:34.451648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '36dd1c40-a863-420b-bd92-ab90f6e131d4'} Aug 30 01:16:34.451648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. (HTTP 404) (Request-ID: req-062bfe6b-3eef-4d9b-ae4c-fa3bd68706ef) Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:34.452469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:16:34.455134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:16:34.457496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ea175ba5-14ca-4c25-bb88-2ebdec6654c4 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Returning 404 to user: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ea175ba5-14ca-4c25-bb88-2ebdec6654c4 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4" status: 404 len: 109 microversion: 2.1 time: 0.088807 Aug 30 01:16:34.458407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 11/19] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Aug 30 01:16:34 2022] GET /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:34.467037 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8b4f9658-f1e5-4e72-bc7b-fac7dcb1e40e tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] Calling method '.version_select at 0x7ff48bc86c10>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:34.534195 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-a015101d-456e-4b5a-8f27-9cf432bb7aa0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Getting quotas for project a69f2b2876ed47459a8b960ff679c724. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:16:34.549356 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-a015101d-456e-4b5a-8f27-9cf432bb7aa0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Getting quotas for user d5bd0cb311db42d7882a4cf90b0d85e8 and project a69f2b2876ed47459a8b960ff679c724. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:16:34.672140 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a015101d-456e-4b5a-8f27-9cf432bb7aa0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.918890 Aug 30 01:16:34.673033 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 9/20] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Aug 30 01:16:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:34.677508 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-74735c27-288a-4e87-8170-62dd2c9fdf66 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bcac280>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:34.780190 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8b4f9658-f1e5-4e72-bc7b-fac7dcb1e40e tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.326539 Aug 30 01:16:34.781059 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 12/21] 10.222.0.44 () {58 vars in 1149 bytes} [Tue Aug 30 01:16:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:34.874532 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-74735c27-288a-4e87-8170-62dd2c9fdf66 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] HTTP exception thrown: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-74735c27-288a-4e87-8170-62dd2c9fdf66 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Request method failure captured: Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4 HTTP/1.1 Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWTkoS9WHHA_GQpJlJEtP431HMndu9aJ46h94Vgd0pkNkia2DD1LHhHJV0iYuu_T3Os15bEcJKpq_jK30rL6yUx8e8UCMyJmHppyLgvf5Bwrh-x-US2n_SN2spQ-1Ms9cjjQvxWWRu0xw0i0xXA3m0V0-FcTVaNxA6d_DOThB1GedxE Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: c64e4eccf2c14dba96cbc1d8c4ab7831 Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-274407389 Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:16:34.880145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:16:34.881202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:16:34.881202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-VolumesSnapshotsTestJSON-274407389 Aug 30 01:16:34.881202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: c64e4eccf2c14dba96cbc1d8c4ab7831 Aug 30 01:16:34.881202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-274407389 Aug 30 01:16:34.881202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-VolumesSnapshotsTestJSON-274407389-project Aug 30 01:16:34.881202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:16:34.881202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:16:34.881202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: e3352d04e04942aa87180eccc1597d52 Aug 30 01:16:34.881202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-VolumesSnapshotsTestJSON-274407389-project Aug 30 01:16:34.881202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: Aug 30 01:16:34.881202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:34.881202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '36dd1c40-a863-420b-bd92-ab90f6e131d4'} Aug 30 01:16:34.881202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. (HTTP 404) (Request-ID: req-b7a5167b-7d1e-49ef-b0e1-da22a79ae4a9) Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:34.881789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:16:34.882666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 01:16:34.883488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:16:34.885156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:34.885156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.885156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:34.885156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.885156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:34.885156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:34.885156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:34.885156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:16:34.885156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:16:34.885156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:34.885156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:34.886834 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-74735c27-288a-4e87-8170-62dd2c9fdf66 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Returning 404 to user: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:34.887837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-74735c27-288a-4e87-8170-62dd2c9fdf66 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4" status: 404 len: 109 microversion: 2.1 time: 0.213887 Aug 30 01:16:34.889049 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 10/22] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Aug 30 01:16:34 2022] DELETE /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4 => generated 109 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:34.905513 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-89010260-d5cf-491f-9b98-159dc4d1faac tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] Calling method '.version_select at 0x7ff48c69d280>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:35.304022 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-89010260-d5cf-491f-9b98-159dc4d1faac tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.413997 Aug 30 01:16:35.305037 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 11/23] 10.222.0.44 () {58 vars in 1134 bytes} [Tue Aug 30 01:16:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:35.310925 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b65232af-ef8d-4a02-b20f-268095d663c8 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Calling method '.version_select at 0x7ff48bc28310>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:35.400124 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-b65232af-ef8d-4a02-b20f-268095d663c8 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] HTTP exception thrown: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:35.400830 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2010751712", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b65232af-ef8d-4a02-b20f-268095d663c8 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Request method failure captured: Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4 HTTP/1.1 Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWTkoS9WHHA_GQpJlJEtP431HMndu9aJ46h94Vgd0pkNkia2DD1LHhHJV0iYuu_T3Os15bEcJKpq_jK30rL6yUx8e8UCMyJmHppyLgvf5Bwrh-x-US2n_SN2spQ-1Ms9cjjQvxWWRu0xw0i0xXA3m0V0-FcTVaNxA6d_DOThB1GedxE Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: c64e4eccf2c14dba96cbc1d8c4ab7831 Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-274407389 Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:16:35.404594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:16:35.405876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c64e4eccf2c14dba96cbc1d8c4ab7831"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:16:35.405876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-VolumesSnapshotsTestJSON-274407389 Aug 30 01:16:35.405876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: c64e4eccf2c14dba96cbc1d8c4ab7831 Aug 30 01:16:35.405876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-274407389 Aug 30 01:16:35.405876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-VolumesSnapshotsTestJSON-274407389-project Aug 30 01:16:35.405876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:16:35.405876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:16:35.405876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: e3352d04e04942aa87180eccc1597d52 Aug 30 01:16:35.405876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-VolumesSnapshotsTestJSON-274407389-project Aug 30 01:16:35.405876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: Aug 30 01:16:35.405876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:35.405876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '36dd1c40-a863-420b-bd92-ab90f6e131d4'} Aug 30 01:16:35.405876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. (HTTP 404) (Request-ID: req-016d195a-5bde-4ef9-8d0b-5c3df7e5b997) Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:35.406706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:16:35.407738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:16:35.408985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:16:35.410028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:35.410028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:35.410028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:35.410028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:35.410028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:35.410028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:35.410028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:35.410028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:16:35.410028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:16:35.410028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. Aug 30 01:16:35.410028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:35.413013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b65232af-ef8d-4a02-b20f-268095d663c8 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] Returning 404 to user: Volume 36dd1c40-a863-420b-bd92-ab90f6e131d4 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:35.414895 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b65232af-ef8d-4a02-b20f-268095d663c8 tempest-VolumesSnapshotsTestJSON-274407389 tempest-VolumesSnapshotsTestJSON-274407389-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4" status: 404 len: 109 microversion: 2.1 time: 0.108041 Aug 30 01:16:35.416632 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 12/24] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Aug 30 01:16:35 2022] GET /compute/v2.1/os-volumes/36dd1c40-a863-420b-bd92-ab90f6e131d4 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:35.428141 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-186d2609-06a0-4671-8832-abf913f12648 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] Calling method '.version_select at 0x7ff48bcac820>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:35.706058 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-186d2609-06a0-4671-8832-abf913f12648 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.288078 Aug 30 01:16:35.706681 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 13/25] 10.222.0.44 () {58 vars in 1167 bytes} [Tue Aug 30 01:16:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:35.722850 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-46fcc28d-988c-4605-a73f-3db46a7243e3 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] Calling method '.version_select at 0x7ff48bc289d0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:35.751957 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] validate_networks() for [('b2938f22-9675-44ea-8234-907289538481', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:16:35.957978 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-46fcc28d-988c-4605-a73f-3db46a7243e3 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.239933 Aug 30 01:16:35.958554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 14/26] 10.222.0.44 () {58 vars in 1170 bytes} [Tue Aug 30 01:16:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:16:35.981645 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4161dfe1-13b8-45a6-abfe-7ef590440756 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] Calling method '.version_select at 0x7ff48bbaf280>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:36.245250 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4161dfe1-13b8-45a6-abfe-7ef590440756 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.267280 Aug 30 01:16:36.246268 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 15/27] 10.222.0.44 () {58 vars in 1155 bytes} [Tue Aug 30 01:16:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:16:36.271680 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1b86a9d2-58c5-4a78-8c66-8ba237aa53a7 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] Calling method '.version_select at 0x7ff48bbaf9d0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:36.557062 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1b86a9d2-58c5-4a78-8c66-8ba237aa53a7 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.297841 Aug 30 01:16:36.558076 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 16/28] 10.222.0.44 () {58 vars in 1188 bytes} [Tue Aug 30 01:16:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:16:36.586204 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-450d9dd5-2b81-4189-87bc-a5e5a967ad91 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] Calling method '.version_select at 0x7ff48bc28310>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:37.094605 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-450d9dd5-2b81-4189-87bc-a5e5a967ad91 tempest-VolumesTestJSON-1096216838 tempest-VolumesTestJSON-1096216838-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.519423 Aug 30 01:16:37.095686 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 17/29] 10.222.0.44 () {58 vars in 1155 bytes} [Tue Aug 30 01:16:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:38.552023 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:16:38.556725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:16:38.557222 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:16:38.557628 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:16:38.558042 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:16:38.595956 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:38.605425 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:38.606352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:38.608989 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:38.609679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:38.611277 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:38.735673 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Getting quotas for project adf47975f465467498be24ebe2c81ad7. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:16:38.756838 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Getting quotas for user 6d5a0cf37e3b4d3084a178f83642c144 and project adf47975f465467498be24ebe2c81ad7. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:16:38.788489 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:16:38.797821 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:16:38.969139 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b3e2d057-7bba-44e6-b5f4-99aa574067ac tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.186818 Aug 30 01:16:38.984808 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 13/30] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:16:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 4203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:16:39.010118 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f59b7bcc-7010-4a28-a808-998814eecd52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:39.014285 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f59b7bcc-7010-4a28-a808-998814eecd52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:39.265225 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-866919983", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "networks": [{"uuid": "4d9d034b-2058-4bea-b0ad-f251a5b7169c"}]}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:39.480769 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f59b7bcc-7010-4a28-a808-998814eecd52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:39.500385 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] validate_networks() for [('4d9d034b-2058-4bea-b0ad-f251a5b7169c', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:16:39.578345 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f59b7bcc-7010-4a28-a808-998814eecd52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1222 microversion: 2.1 time: 0.591650 Aug 30 01:16:39.590486 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 14/31] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:38 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1222 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:40.091699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1675304145", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:40.382607 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] validate_networks() for [('b2938f22-9675-44ea-8234-907289538481', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:16:42.240115 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:16:42.241574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:16:42.242700 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:16:42.244330 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:16:42.245645 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:16:42.277822 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:42.278727 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:42.280949 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:42.281965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:42.287034 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:42.287924 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:42.345760 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Getting quotas for project adf47975f465467498be24ebe2c81ad7. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:16:42.366504 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Getting quotas for user 6d5a0cf37e3b4d3084a178f83642c144 and project adf47975f465467498be24ebe2c81ad7. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:16:42.405975 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:16:42.413706 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:16:42.634730 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5b364bf2-035d-4f2c-84ac-60a5ad852504 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.562197 Aug 30 01:16:42.667513 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 15/32] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:16:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:16:42.695851 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-401219968", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8469c42-cfe3-468a-82da-a1b36c332c12"}], "security_groups": [{"name": "tempest-securitygroup--1434286944"}], "key_name": "tempest-keypair-859645508", "user_data": "}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:42.960708 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] validate_networks() for [('b8469c42-cfe3-468a-82da-a1b36c332c12', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:16:43.152066 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:16:43.153252 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:16:43.153753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:16:43.154158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:16:43.154635 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:16:43.181661 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:43.182346 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:43.182660 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:43.183484 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:43.191352 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:43.192206 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:43.255493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Getting quotas for project 9bf90b4e09e94cc984fe36b03b08a0b6. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:16:43.261495 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Getting quotas for user 5b2e7c46b6aa4800834115196866b244 and project 9bf90b4e09e94cc984fe36b03b08a0b6. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:16:43.301418 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:16:43.314137 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:16:43.472977 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-66fd4329-0f9a-40d7-8f13-59f31e027d6f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.689465 Aug 30 01:16:43.473874 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 18/33] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:16:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 4691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:16:43.483527 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-50217ca9-287e-4e70-9fe4-e0a7cd305442 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:43.487039 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-50217ca9-287e-4e70-9fe4-e0a7cd305442 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:43.880074 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-50217ca9-287e-4e70-9fe4-e0a7cd305442 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:43.953680 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-50217ca9-287e-4e70-9fe4-e0a7cd305442 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1222 microversion: 2.1 time: 0.477889 Aug 30 01:16:43.971462 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 19/34] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:43 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1222 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:43.979929 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7af45754-f68a-413f-82b0-36bafe86a595 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:43.999881 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7af45754-f68a-413f-82b0-36bafe86a595 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:44.178109 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:16:44.178807 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:16:44.178940 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:16:44.180186 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:16:44.181402 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:16:44.204708 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:44.205259 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:44.208677 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:44.211540 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:44.212061 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:44.212512 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:44.371210 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Getting quotas for project a69f2b2876ed47459a8b960ff679c724. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:16:44.392427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Getting quotas for user d5bd0cb311db42d7882a4cf90b0d85e8 and project a69f2b2876ed47459a8b960ff679c724. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:16:44.401782 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7af45754-f68a-413f-82b0-36bafe86a595 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:44.415289 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7af45754-f68a-413f-82b0-36bafe86a595 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1214 microversion: 2.1 time: 0.437257 Aug 30 01:16:44.416919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 20/35] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:43 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1214 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:44.429997 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:16:44.445645 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:16:44.629547 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-02f95d56-4c86-4a42-8344-9c8a008061ce tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.960220 Aug 30 01:16:44.638177 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 16/36] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:16:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:16:44.644078 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3483ab98-084f-41c1-a79e-c5c54b701c6c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:44.645014 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3483ab98-084f-41c1-a79e-c5c54b701c6c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:45.010095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-62a975d0-5643-46a1-a400-cf776e8f559d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:45.011265 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-62a975d0-5643-46a1-a400-cf776e8f559d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:45.058199 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3483ab98-084f-41c1-a79e-c5c54b701c6c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:45.064346 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62a975d0-5643-46a1-a400-cf776e8f559d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:45.073214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62a975d0-5643-46a1-a400-cf776e8f559d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:45.074072 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62a975d0-5643-46a1-a400-cf776e8f559d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:45.076792 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62a975d0-5643-46a1-a400-cf776e8f559d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:45.078273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62a975d0-5643-46a1-a400-cf776e8f559d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:45.078833 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62a975d0-5643-46a1-a400-cf776e8f559d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:45.092257 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3483ab98-084f-41c1-a79e-c5c54b701c6c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1236 microversion: 2.1 time: 0.446750 Aug 30 01:16:45.101816 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 21/37] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:44 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1236 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:16:45.459496 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-00b52a40-0c1a-4419-8a2c-4d1a5e11dfbb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:45.465656 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-00b52a40-0c1a-4419-8a2c-4d1a5e11dfbb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:45.497919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00b52a40-0c1a-4419-8a2c-4d1a5e11dfbb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:45.529729 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00b52a40-0c1a-4419-8a2c-4d1a5e11dfbb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:45.534992 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00b52a40-0c1a-4419-8a2c-4d1a5e11dfbb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:45.550474 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00b52a40-0c1a-4419-8a2c-4d1a5e11dfbb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:45.570486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00b52a40-0c1a-4419-8a2c-4d1a5e11dfbb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:45.572570 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00b52a40-0c1a-4419-8a2c-4d1a5e11dfbb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:46.340946 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-62a975d0-5643-46a1-a400-cf776e8f559d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:46.370666 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-62a975d0-5643-46a1-a400-cf776e8f559d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1218 microversion: 2.1 time: 1.366777 Aug 30 01:16:46.390666 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 17/38] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:45 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1218 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:16:46.427218 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-45b6dc0a-7493-45e0-a834-b8188ccc189c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:46.431904 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-45b6dc0a-7493-45e0-a834-b8188ccc189c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:46.494911 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45b6dc0a-7493-45e0-a834-b8188ccc189c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:46.496282 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45b6dc0a-7493-45e0-a834-b8188ccc189c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:46.498178 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45b6dc0a-7493-45e0-a834-b8188ccc189c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:46.499140 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45b6dc0a-7493-45e0-a834-b8188ccc189c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:46.500988 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45b6dc0a-7493-45e0-a834-b8188ccc189c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:46.502156 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45b6dc0a-7493-45e0-a834-b8188ccc189c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:46.716032 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-45b6dc0a-7493-45e0-a834-b8188ccc189c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:46.724375 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-45b6dc0a-7493-45e0-a834-b8188ccc189c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1240 microversion: 2.1 time: 0.329371 Aug 30 01:16:46.729192 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 18/39] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:46 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1240 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:46.836991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-00b52a40-0c1a-4419-8a2c-4d1a5e11dfbb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:46.893754 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-00b52a40-0c1a-4419-8a2c-4d1a5e11dfbb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1210 microversion: 2.1 time: 1.454955 Aug 30 01:16:46.902410 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 22/40] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:45 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1210 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:47.410936 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e1e95ec7-0cdb-4e46-820e-8e4717fa6f5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:47.419414 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e1e95ec7-0cdb-4e46-820e-8e4717fa6f5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:47.435256 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1e95ec7-0cdb-4e46-820e-8e4717fa6f5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:47.448087 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1e95ec7-0cdb-4e46-820e-8e4717fa6f5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:47.448792 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1e95ec7-0cdb-4e46-820e-8e4717fa6f5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:47.449730 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1e95ec7-0cdb-4e46-820e-8e4717fa6f5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:47.454299 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1e95ec7-0cdb-4e46-820e-8e4717fa6f5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:47.456026 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1e95ec7-0cdb-4e46-820e-8e4717fa6f5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:47.807824 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9c6a6150-ac8c-4df1-b222-544d97e0dad5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:47.808939 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9c6a6150-ac8c-4df1-b222-544d97e0dad5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:47.827697 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9c6a6150-ac8c-4df1-b222-544d97e0dad5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:47.835853 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9c6a6150-ac8c-4df1-b222-544d97e0dad5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:47.838140 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9c6a6150-ac8c-4df1-b222-544d97e0dad5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:47.842712 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9c6a6150-ac8c-4df1-b222-544d97e0dad5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:47.844397 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9c6a6150-ac8c-4df1-b222-544d97e0dad5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:47.847166 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9c6a6150-ac8c-4df1-b222-544d97e0dad5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:48.097466 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e1e95ec7-0cdb-4e46-820e-8e4717fa6f5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:48.113778 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e1e95ec7-0cdb-4e46-820e-8e4717fa6f5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1282 microversion: 2.1 time: 0.706378 Aug 30 01:16:48.135716 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 19/41] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:47 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1282 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:48.142766 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9c6a6150-ac8c-4df1-b222-544d97e0dad5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:48.156547 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9c6a6150-ac8c-4df1-b222-544d97e0dad5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1240 microversion: 2.1 time: 0.352171 Aug 30 01:16:48.163181 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 23/42] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:47 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1240 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:48.167385 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b5e96f88-aa78-41c9-8972-00696eca8748 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:48.170580 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b5e96f88-aa78-41c9-8972-00696eca8748 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:48.220804 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5e96f88-aa78-41c9-8972-00696eca8748 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:48.243305 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5e96f88-aa78-41c9-8972-00696eca8748 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:48.256627 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5e96f88-aa78-41c9-8972-00696eca8748 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:48.258983 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5e96f88-aa78-41c9-8972-00696eca8748 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:48.262088 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5e96f88-aa78-41c9-8972-00696eca8748 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:48.269836 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5e96f88-aa78-41c9-8972-00696eca8748 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:48.620700 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b5e96f88-aa78-41c9-8972-00696eca8748 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:48.645081 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b5e96f88-aa78-41c9-8972-00696eca8748 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1284 microversion: 2.1 time: 0.507735 Aug 30 01:16:48.648353 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 20/43] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:48 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1284 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:49.138745 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-82305184-0a4e-480c-8579-33461f07ec00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:49.139464 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-82305184-0a4e-480c-8579-33461f07ec00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:49.173496 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-82305184-0a4e-480c-8579-33461f07ec00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:49.177454 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-82305184-0a4e-480c-8579-33461f07ec00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:49.178075 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-82305184-0a4e-480c-8579-33461f07ec00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:49.178962 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-82305184-0a4e-480c-8579-33461f07ec00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:49.186049 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-82305184-0a4e-480c-8579-33461f07ec00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:49.196767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-82305184-0a4e-480c-8579-33461f07ec00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:49.206184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e1b66161-c106-4d79-8f41-eae436b04014 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:49.207238 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e1b66161-c106-4d79-8f41-eae436b04014 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:49.247589 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1b66161-c106-4d79-8f41-eae436b04014 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:49.257441 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1b66161-c106-4d79-8f41-eae436b04014 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:49.264736 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1b66161-c106-4d79-8f41-eae436b04014 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:49.269909 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1b66161-c106-4d79-8f41-eae436b04014 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:49.270469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1b66161-c106-4d79-8f41-eae436b04014 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:49.271071 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1b66161-c106-4d79-8f41-eae436b04014 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:49.794260 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-82305184-0a4e-480c-8579-33461f07ec00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:49.826642 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-82305184-0a4e-480c-8579-33461f07ec00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1280 microversion: 2.1 time: 0.692982 Aug 30 01:16:49.844371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 24/44] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:49 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1280 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:49.881564 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9243941e-8ba3-4bce-a0fc-495b3407ab50 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:49.894949 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9243941e-8ba3-4bce-a0fc-495b3407ab50 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:49.931985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9243941e-8ba3-4bce-a0fc-495b3407ab50 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:49.934741 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9243941e-8ba3-4bce-a0fc-495b3407ab50 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:49.936910 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9243941e-8ba3-4bce-a0fc-495b3407ab50 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:49.937755 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9243941e-8ba3-4bce-a0fc-495b3407ab50 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:49.938614 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9243941e-8ba3-4bce-a0fc-495b3407ab50 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:49.939758 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9243941e-8ba3-4bce-a0fc-495b3407ab50 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:50.005221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e1b66161-c106-4d79-8f41-eae436b04014 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:50.027401 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e1b66161-c106-4d79-8f41-eae436b04014 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1288 microversion: 2.1 time: 0.826461 Aug 30 01:16:50.037815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 21/45] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:49 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1288 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:50.866799 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e72d8305-a005-4481-9cd8-3c95ab84a8c2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:50.868160 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e72d8305-a005-4481-9cd8-3c95ab84a8c2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:50.885606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e72d8305-a005-4481-9cd8-3c95ab84a8c2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:50.887780 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e72d8305-a005-4481-9cd8-3c95ab84a8c2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:50.890258 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e72d8305-a005-4481-9cd8-3c95ab84a8c2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:50.893505 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e72d8305-a005-4481-9cd8-3c95ab84a8c2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:50.896721 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e72d8305-a005-4481-9cd8-3c95ab84a8c2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:50.899130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e72d8305-a005-4481-9cd8-3c95ab84a8c2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:51.159080 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e72d8305-a005-4481-9cd8-3c95ab84a8c2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:51.171670 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e72d8305-a005-4481-9cd8-3c95ab84a8c2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1280 microversion: 2.1 time: 0.309304 Aug 30 01:16:51.181259 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 22/46] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:50 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1280 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:51.215085 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b938cb8a-5226-4c4b-9739-e5eb2915c57c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:51.216317 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b938cb8a-5226-4c4b-9739-e5eb2915c57c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:51.252761 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9243941e-8ba3-4bce-a0fc-495b3407ab50 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:51.257282 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b938cb8a-5226-4c4b-9739-e5eb2915c57c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:51.263614 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b938cb8a-5226-4c4b-9739-e5eb2915c57c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:51.266565 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b938cb8a-5226-4c4b-9739-e5eb2915c57c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:51.273172 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9243941e-8ba3-4bce-a0fc-495b3407ab50 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1272 microversion: 2.1 time: 1.407593 Aug 30 01:16:51.275433 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 25/47] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:49 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1272 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:51.276138 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b938cb8a-5226-4c4b-9739-e5eb2915c57c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:51.276804 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b938cb8a-5226-4c4b-9739-e5eb2915c57c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:51.286739 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b938cb8a-5226-4c4b-9739-e5eb2915c57c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:51.840826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b938cb8a-5226-4c4b-9739-e5eb2915c57c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:51.858166 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b938cb8a-5226-4c4b-9739-e5eb2915c57c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1294 microversion: 2.1 time: 0.674087 Aug 30 01:16:51.859353 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 23/48] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:51 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1294 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:52.225208 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1fe57912-9608-4549-86cb-b032a5d6c94b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:52.233292 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1fe57912-9608-4549-86cb-b032a5d6c94b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:52.268300 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1fe57912-9608-4549-86cb-b032a5d6c94b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.273283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1fe57912-9608-4549-86cb-b032a5d6c94b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.276294 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1fe57912-9608-4549-86cb-b032a5d6c94b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:52.279365 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1fe57912-9608-4549-86cb-b032a5d6c94b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.282657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1fe57912-9608-4549-86cb-b032a5d6c94b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.283759 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1fe57912-9608-4549-86cb-b032a5d6c94b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:52.305745 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3531c242-69a8-4d9d-961c-3951b703f063 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Action: 'create', calling method: .version_select at 0x7ff48b23c4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-748775305", "metadata": {"Type": "work"}}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3531c242-69a8-4d9d-961c-3951b703f063 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Request method failure captured: Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 121 Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWUDoxUZACHsW25bSY6i9Di3781zeheL7z7d0YWPG8rUockUAThDVXfUAE8ZeGCg68BYvAUZ30Lozl0uyP_d3Ru-EHjcFKDRkMIr760EL8gqUZz1F76w7CZVK03ODB7yQjffqtIEVtjA090ZRKE975-6h2A3BDTMKr_fCLGLFFlTC_M Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: 1d08fe83431444178f99d3d8e04bec87 Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:16:52.314886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:16:52.317387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:16:52.317387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.317387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 1d08fe83431444178f99d3d8e04bec87 Aug 30 01:16:52.317387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.317387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-VolumesNegativeTest-1267326247-project Aug 30 01:16:52.317387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:16:52.317387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:16:52.317387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 0ab7330e3be540cdb3728b6ff2430631 Aug 30 01:16:52.317387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-VolumesNegativeTest-1267326247-project Aug 30 01:16:52.317387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Aug 30 01:16:52.317387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-748775305", "metadata": {"Type": "work"}}} Aug 30 01:16:52.317387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: Aug 30 01:16:52.317387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-748775305', 'metadata': {'Type': 'work'}}}} Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise error Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:52.318802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 01:16:52.321202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 01:16:52.325572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 01:16:52.325572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.325572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3531c242-69a8-4d9d-961c-3951b703f063 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:52.325572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3531c242-69a8-4d9d-961c-3951b703f063 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.595176 Aug 30 01:16:52.325572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 26/49] 10.222.0.44 () {60 vars in 1156 bytes} [Tue Aug 30 01:16:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 597 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 01:16:52.336412 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f734790c-abf5-4de1-9f87-169e7f969c11 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:52.339333 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f734790c-abf5-4de1-9f87-169e7f969c11 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:52.368615 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f734790c-abf5-4de1-9f87-169e7f969c11 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.370424 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f734790c-abf5-4de1-9f87-169e7f969c11 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.370906 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f734790c-abf5-4de1-9f87-169e7f969c11 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:52.372459 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f734790c-abf5-4de1-9f87-169e7f969c11 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.373105 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f734790c-abf5-4de1-9f87-169e7f969c11 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.373769 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f734790c-abf5-4de1-9f87-169e7f969c11 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:52.469088 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1fe57912-9608-4549-86cb-b032a5d6c94b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:52.481549 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1fe57912-9608-4549-86cb-b032a5d6c94b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1280 microversion: 2.1 time: 0.276273 Aug 30 01:16:52.482773 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 24/50] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:52 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1280 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:52.488335 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dc26ed0d-2fbc-402f-b5e0-9b14235d849d tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Action: 'create', calling method: .version_select at 0x7ff48b243a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-177674508", "metadata": {"Type": "work"}}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dc26ed0d-2fbc-402f-b5e0-9b14235d849d tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Request method failure captured: Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 119 Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWUDoxUZACHsW25bSY6i9Di3781zeheL7z7d0YWPG8rUockUAThDVXfUAE8ZeGCg68BYvAUZ30Lozl0uyP_d3Ru-EHjcFKDRkMIr760EL8gqUZz1F76w7CZVK03ODB7yQjffqtIEVtjA090ZRKE975-6h2A3BDTMKr_fCLGLFFlTC_M Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 1d08fe83431444178f99d3d8e04bec87 Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:16:52.494128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:16:52.495461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:16:52.495461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.495461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 1d08fe83431444178f99d3d8e04bec87 Aug 30 01:16:52.495461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.495461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesNegativeTest-1267326247-project Aug 30 01:16:52.495461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:16:52.495461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:16:52.495461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 0ab7330e3be540cdb3728b6ff2430631 Aug 30 01:16:52.495461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesNegativeTest-1267326247-project Aug 30 01:16:52.495461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Aug 30 01:16:52.495461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-177674508", "metadata": {"Type": "work"}}} Aug 30 01:16:52.495461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: Aug 30 01:16:52.495461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-177674508', 'metadata': {'Type': 'work'}}}} Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise error Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi '0' Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:52.496255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 01:16:52.497488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 01:16:52.498488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 01:16:52.498488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.499613 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dc26ed0d-2fbc-402f-b5e0-9b14235d849d tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:52.501164 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dc26ed0d-2fbc-402f-b5e0-9b14235d849d tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017246 Aug 30 01:16:52.502259 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1156 bytes} [Tue Aug 30 01:16:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:16:52.517318 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cbff841f-ba6d-4740-84b4-86e370c2ee22 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Action: 'create', calling method: .version_select at 0x7ff48b2d4550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1589966239", "metadata": {"Type": "work"}}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cbff841f-ba6d-4740-84b4-86e370c2ee22 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Request method failure captured: Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 119 Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWUDoxUZACHsW25bSY6i9Di3781zeheL7z7d0YWPG8rUockUAThDVXfUAE8ZeGCg68BYvAUZ30Lozl0uyP_d3Ru-EHjcFKDRkMIr760EL8gqUZz1F76w7CZVK03ODB7yQjffqtIEVtjA090ZRKE975-6h2A3BDTMKr_fCLGLFFlTC_M Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 1d08fe83431444178f99d3d8e04bec87 Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:16:52.532819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:16:52.534447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:16:52.534447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.534447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 1d08fe83431444178f99d3d8e04bec87 Aug 30 01:16:52.534447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.534447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesNegativeTest-1267326247-project Aug 30 01:16:52.534447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:16:52.534447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:16:52.534447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 0ab7330e3be540cdb3728b6ff2430631 Aug 30 01:16:52.534447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesNegativeTest-1267326247-project Aug 30 01:16:52.534447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Aug 30 01:16:52.534447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1589966239", "metadata": {"Type": "work"}}} Aug 30 01:16:52.534447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: Aug 30 01:16:52.534447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1589966239', 'metadata': {'Type': 'work'}}}} Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise error Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi '' Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:52.535360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 01:16:52.537420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 01:16:52.538447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 01:16:52.538447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.538447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cbff841f-ba6d-4740-84b4-86e370c2ee22 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:52.538447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cbff841f-ba6d-4740-84b4-86e370c2ee22 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023862 Aug 30 01:16:52.542306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 26/52] 10.222.0.44 () {60 vars in 1156 bytes} [Tue Aug 30 01:16:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 01:16:52.548912 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ae3a4126-eade-401f-a09e-3dd0a6395aee tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Calling method '.version_select at 0x7ff48b29d5e0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:52.601173 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-ae3a4126-eade-401f-a09e-3dd0a6395aee tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] HTTP exception thrown: Volume tempest-invalid-1010511376 could not be found. Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ae3a4126-eade-401f-a09e-3dd0a6395aee tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Request method failure captured: Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1010511376 HTTP/1.1 Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWUDoxUZACHsW25bSY6i9Di3781zeheL7z7d0YWPG8rUockUAThDVXfUAE8ZeGCg68BYvAUZ30Lozl0uyP_d3Ru-EHjcFKDRkMIr760EL8gqUZz1F76w7CZVK03ODB7yQjffqtIEVtjA090ZRKE975-6h2A3BDTMKr_fCLGLFFlTC_M Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 1d08fe83431444178f99d3d8e04bec87 Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:16:52.606235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:16:52.607517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:16:52.607517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.607517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 1d08fe83431444178f99d3d8e04bec87 Aug 30 01:16:52.607517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.607517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesNegativeTest-1267326247-project Aug 30 01:16:52.607517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:16:52.607517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:16:52.607517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 0ab7330e3be540cdb3728b6ff2430631 Aug 30 01:16:52.607517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesNegativeTest-1267326247-project Aug 30 01:16:52.607517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: Aug 30 01:16:52.607517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Volume tempest-invalid-1010511376 could not be found. Aug 30 01:16:52.607517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': 'tempest-invalid-1010511376'} Aug 30 01:16:52.607517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1010511376 could not be found. (HTTP 404) (Request-ID: req-6c7e2921-e354-44c3-b4ee-666a3be831a6) Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.608283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:16:52.609419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1010511376 could not be found. Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:16:52.611424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1010511376 could not be found. Aug 30 01:16:52.613095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.613095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.613095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.613095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.613095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:52.613095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:52.613095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:16:52.613095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:16:52.613095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1010511376 could not be found. Aug 30 01:16:52.613095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.613095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ae3a4126-eade-401f-a09e-3dd0a6395aee tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Returning 404 to user: Volume tempest-invalid-1010511376 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:52.613095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ae3a4126-eade-401f-a09e-3dd0a6395aee tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1010511376" status: 404 len: 99 microversion: 2.1 time: 0.063772 Aug 30 01:16:52.621492 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 27/53] 10.222.0.44 () {58 vars in 1218 bytes} [Tue Aug 30 01:16:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1010511376 => generated 99 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 01:16:52.631446 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9ac2242c-b98e-4072-a565-2beb272cdecc tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003999 Aug 30 01:16:52.644205 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 28/54] 10.222.0.44 () {58 vars in 1140 bytes} [Tue Aug 30 01:16:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 01:16:52.661528 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-15b1d9d1-7313-4d16-8305-767f04208f0e tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016113 Aug 30 01:16:52.671577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 29/55] 10.222.0.44 () {58 vars in 1137 bytes} [Tue Aug 30 01:16:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 01:16:52.682302 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c8ca2282-e5f1-4880-9a35-d3282c57b788 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Calling method '.version_select at 0x7ff48b2434c0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:52.760907 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-c8ca2282-e5f1-4880-9a35-d3282c57b788 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] HTTP exception thrown: Volume 60bb2634-e12d-47df-8f75-b8b304be7e59 could not be found. Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c8ca2282-e5f1-4880-9a35-d3282c57b788 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Request method failure captured: Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: DELETE /compute/v2.1/os-volumes/60bb2634-e12d-47df-8f75-b8b304be7e59 HTTP/1.1 Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWUDoxUZACHsW25bSY6i9Di3781zeheL7z7d0YWPG8rUockUAThDVXfUAE8ZeGCg68BYvAUZ30Lozl0uyP_d3Ru-EHjcFKDRkMIr760EL8gqUZz1F76w7CZVK03ODB7yQjffqtIEVtjA090ZRKE975-6h2A3BDTMKr_fCLGLFFlTC_M Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 1d08fe83431444178f99d3d8e04bec87 Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:16:52.763297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:16:52.764783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:16:52.764783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.764783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 1d08fe83431444178f99d3d8e04bec87 Aug 30 01:16:52.764783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.764783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesNegativeTest-1267326247-project Aug 30 01:16:52.764783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:16:52.764783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:16:52.764783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 0ab7330e3be540cdb3728b6ff2430631 Aug 30 01:16:52.764783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesNegativeTest-1267326247-project Aug 30 01:16:52.764783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: Aug 30 01:16:52.764783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Volume 60bb2634-e12d-47df-8f75-b8b304be7e59 could not be found. Aug 30 01:16:52.764783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '60bb2634-e12d-47df-8f75-b8b304be7e59'} Aug 30 01:16:52.764783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60bb2634-e12d-47df-8f75-b8b304be7e59 could not be found. (HTTP 404) (Request-ID: req-352cadd2-4a3f-4c70-b53f-5233a2f6f202) Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.765601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:16:52.766815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60bb2634-e12d-47df-8f75-b8b304be7e59 could not be found. Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 01:16:52.767942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:16:52.769202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60bb2634-e12d-47df-8f75-b8b304be7e59 could not be found. Aug 30 01:16:52.769202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.769202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.769202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.769202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.769202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:52.769202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:52.769202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:16:52.769202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:16:52.769202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60bb2634-e12d-47df-8f75-b8b304be7e59 could not be found. Aug 30 01:16:52.769202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.771660 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c8ca2282-e5f1-4880-9a35-d3282c57b788 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Returning 404 to user: Volume 60bb2634-e12d-47df-8f75-b8b304be7e59 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:52.772737 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c8ca2282-e5f1-4880-9a35-d3282c57b788 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/60bb2634-e12d-47df-8f75-b8b304be7e59" status: 404 len: 109 microversion: 2.1 time: 0.100163 Aug 30 01:16:52.774354 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 30/56] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Aug 30 01:16:52 2022] DELETE /compute/v2.1/os-volumes/60bb2634-e12d-47df-8f75-b8b304be7e59 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:52.795179 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c2aa4a96-1185-497c-bdac-d05171b35058 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Calling method '.version_select at 0x7ff48b29d790>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:52.887893 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-c2aa4a96-1185-497c-bdac-d05171b35058 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] HTTP exception thrown: Volume 0703f1e1-a7ff-4459-9732-cc0c5d7d06ad could not be found. Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c2aa4a96-1185-497c-bdac-d05171b35058 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Request method failure captured: Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/os-volumes/0703f1e1-a7ff-4459-9732-cc0c5d7d06ad HTTP/1.1 Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWUDoxUZACHsW25bSY6i9Di3781zeheL7z7d0YWPG8rUockUAThDVXfUAE8ZeGCg68BYvAUZ30Lozl0uyP_d3Ru-EHjcFKDRkMIr760EL8gqUZz1F76w7CZVK03ODB7yQjffqtIEVtjA090ZRKE975-6h2A3BDTMKr_fCLGLFFlTC_M Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 1d08fe83431444178f99d3d8e04bec87 Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:16:52.890273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:16:52.891742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1d08fe83431444178f99d3d8e04bec87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:16:52.891742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.891742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 1d08fe83431444178f99d3d8e04bec87 Aug 30 01:16:52.891742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesNegativeTest-1267326247 Aug 30 01:16:52.891742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesNegativeTest-1267326247-project Aug 30 01:16:52.891742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:16:52.891742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:16:52.891742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 0ab7330e3be540cdb3728b6ff2430631 Aug 30 01:16:52.891742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesNegativeTest-1267326247-project Aug 30 01:16:52.891742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: Aug 30 01:16:52.891742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Volume 0703f1e1-a7ff-4459-9732-cc0c5d7d06ad could not be found. Aug 30 01:16:52.891742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '0703f1e1-a7ff-4459-9732-cc0c5d7d06ad'} Aug 30 01:16:52.891742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0703f1e1-a7ff-4459-9732-cc0c5d7d06ad could not be found. (HTTP 404) (Request-ID: req-2adff22b-7363-42e0-80a8-f698aafe6874) Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.892435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:16:52.893347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0703f1e1-a7ff-4459-9732-cc0c5d7d06ad could not be found. Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:16:52.894309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:16:52.895214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0703f1e1-a7ff-4459-9732-cc0c5d7d06ad could not be found. Aug 30 01:16:52.895214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.895214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:52.895214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.895214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:52.895214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:52.895214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:52.895214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:16:52.895214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:16:52.895214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0703f1e1-a7ff-4459-9732-cc0c5d7d06ad could not be found. Aug 30 01:16:52.895214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:16:52.895214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c2aa4a96-1185-497c-bdac-d05171b35058 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] Returning 404 to user: Volume 0703f1e1-a7ff-4459-9732-cc0c5d7d06ad could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:52.895799 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c2aa4a96-1185-497c-bdac-d05171b35058 tempest-VolumesNegativeTest-1267326247 tempest-VolumesNegativeTest-1267326247-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/0703f1e1-a7ff-4459-9732-cc0c5d7d06ad" status: 404 len: 109 microversion: 2.1 time: 0.113762 Aug 30 01:16:52.904910 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 31/57] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Aug 30 01:16:52 2022] GET /compute/v2.1/os-volumes/0703f1e1-a7ff-4459-9732-cc0c5d7d06ad => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:52.911070 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ec527dea-bfb2-4534-babd-7f43b672d869 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:52.911706 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ec527dea-bfb2-4534-babd-7f43b672d869 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:52.920601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ec527dea-bfb2-4534-babd-7f43b672d869 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.921375 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ec527dea-bfb2-4534-babd-7f43b672d869 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.922038 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ec527dea-bfb2-4534-babd-7f43b672d869 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:52.922936 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ec527dea-bfb2-4534-babd-7f43b672d869 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.923551 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ec527dea-bfb2-4534-babd-7f43b672d869 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.924159 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ec527dea-bfb2-4534-babd-7f43b672d869 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:53.093426 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ec527dea-bfb2-4534-babd-7f43b672d869 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:53.105290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ec527dea-bfb2-4534-babd-7f43b672d869 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1294 microversion: 2.1 time: 0.207655 Aug 30 01:16:53.109314 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 32/58] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:52 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1294 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:53.237857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:53.325750 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f734790c-abf5-4de1-9f87-169e7f969c11 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:53.343345 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f734790c-abf5-4de1-9f87-169e7f969c11 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 1.021096 Aug 30 01:16:53.344228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 27/59] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:52 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:53.527140 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3bf9bd48-61cf-4e6e-a607-d6531b031ccc tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:53.527857 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3bf9bd48-61cf-4e6e-a607-d6531b031ccc tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:53.540430 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3bf9bd48-61cf-4e6e-a607-d6531b031ccc tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:53.542820 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3bf9bd48-61cf-4e6e-a607-d6531b031ccc tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:53.543888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3bf9bd48-61cf-4e6e-a607-d6531b031ccc tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:53.545552 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3bf9bd48-61cf-4e6e-a607-d6531b031ccc tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:53.548980 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3bf9bd48-61cf-4e6e-a607-d6531b031ccc tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:53.549848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3bf9bd48-61cf-4e6e-a607-d6531b031ccc tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:53.930270 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3bf9bd48-61cf-4e6e-a607-d6531b031ccc tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:53.951796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3bf9bd48-61cf-4e6e-a607-d6531b031ccc tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.430384 Aug 30 01:16:53.953922 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 33/60] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:53 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:54.134275 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-23307e2c-6e2f-4709-81f4-c1c18ec7c2fa tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:54.134923 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-23307e2c-6e2f-4709-81f4-c1c18ec7c2fa tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:54.149941 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23307e2c-6e2f-4709-81f4-c1c18ec7c2fa tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:54.150449 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23307e2c-6e2f-4709-81f4-c1c18ec7c2fa tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:54.150895 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23307e2c-6e2f-4709-81f4-c1c18ec7c2fa tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:54.151633 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23307e2c-6e2f-4709-81f4-c1c18ec7c2fa tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:54.152130 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23307e2c-6e2f-4709-81f4-c1c18ec7c2fa tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:54.154155 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23307e2c-6e2f-4709-81f4-c1c18ec7c2fa tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:54.338121 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-23307e2c-6e2f-4709-81f4-c1c18ec7c2fa tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:54.356416 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-23307e2c-6e2f-4709-81f4-c1c18ec7c2fa tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1294 microversion: 2.1 time: 0.227665 Aug 30 01:16:54.357358 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 28/61] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:54 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1294 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:54.370043 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:54.387163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f1477ae9-aa4f-42af-90dd-4c6d7b923056 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:54.389097 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f1477ae9-aa4f-42af-90dd-4c6d7b923056 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:54.411866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1477ae9-aa4f-42af-90dd-4c6d7b923056 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:54.418895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1477ae9-aa4f-42af-90dd-4c6d7b923056 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:54.419583 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1477ae9-aa4f-42af-90dd-4c6d7b923056 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:54.425952 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1477ae9-aa4f-42af-90dd-4c6d7b923056 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:54.426677 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1477ae9-aa4f-42af-90dd-4c6d7b923056 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:54.440907 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1477ae9-aa4f-42af-90dd-4c6d7b923056 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:54.441387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=20 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:54.981231 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-33899995-cc2d-4520-b9ba-7d93479b8b00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:54.986026 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-33899995-cc2d-4520-b9ba-7d93479b8b00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:55.015464 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33899995-cc2d-4520-b9ba-7d93479b8b00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:55.016498 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33899995-cc2d-4520-b9ba-7d93479b8b00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:55.017053 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33899995-cc2d-4520-b9ba-7d93479b8b00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:55.018036 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33899995-cc2d-4520-b9ba-7d93479b8b00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:55.018591 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33899995-cc2d-4520-b9ba-7d93479b8b00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:55.019067 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33899995-cc2d-4520-b9ba-7d93479b8b00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:55.076231 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=16 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:55.268924 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f1477ae9-aa4f-42af-90dd-4c6d7b923056 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:55.329855 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f1477ae9-aa4f-42af-90dd-4c6d7b923056 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.961076 Aug 30 01:16:55.359869 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 34/62] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:54 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:55.822701 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-eb17e6aa-546a-42d6-b42c-48ec7c015235 req-9b8ef21b-e298-4cd7-aba8-e86214f6068b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26186b86-98dd-4907-8665-3358fa62eb1e", "tag": "732b6f50-130f-420b-8b3a-711de6b71f4a"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:55.863065 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-eb17e6aa-546a-42d6-b42c-48ec7c015235 req-9b8ef21b-e298-4cd7-aba8-e86214f6068b service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:55.865006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-eb17e6aa-546a-42d6-b42c-48ec7c015235 req-9b8ef21b-e298-4cd7-aba8-e86214f6068b service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:55.869429 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-eb17e6aa-546a-42d6-b42c-48ec7c015235 req-9b8ef21b-e298-4cd7-aba8-e86214f6068b service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:55.939701 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-eb17e6aa-546a-42d6-b42c-48ec7c015235 req-9b8ef21b-e298-4cd7-aba8-e86214f6068b service nova] Creating event network-changed:732b6f50-130f-420b-8b3a-711de6b71f4a for instance 26186b86-98dd-4907-8665-3358fa62eb1e on hv-cinder-81514 Aug 30 01:16:55.941255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-eb17e6aa-546a-42d6-b42c-48ec7c015235 req-9b8ef21b-e298-4cd7-aba8-e86214f6068b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120706) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 01:16:55.943308 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-eb17e6aa-546a-42d6-b42c-48ec7c015235 req-9b8ef21b-e298-4cd7-aba8-e86214f6068b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120706) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 01:16:55.945667 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a64a0134-e0b3-4b7f-a8b4-c00f30db400a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:55.949873 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a64a0134-e0b3-4b7f-a8b4-c00f30db400a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:55.950675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a64a0134-e0b3-4b7f-a8b4-c00f30db400a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:55.953044 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a64a0134-e0b3-4b7f-a8b4-c00f30db400a None None] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:55.956006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a64a0134-e0b3-4b7f-a8b4-c00f30db400a None None] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:55.957309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a64a0134-e0b3-4b7f-a8b4-c00f30db400a None None] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:56.012775 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.compute.rpcapi [None req-a64a0134-e0b3-4b7f-a8b4-c00f30db400a None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 01:16:56.016976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a64a0134-e0b3-4b7f-a8b4-c00f30db400a None None] Releasing lock "compute-rpcapi-router" {{(pid=120706) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 01:16:56.064935 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a64a0134-e0b3-4b7f-a8b4-c00f30db400a None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.701674 Aug 30 01:16:56.069466 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 35/63] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:56.087521 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6eb50582-e244-4e64-a6a5-fe165165336a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:56.090564 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6eb50582-e244-4e64-a6a5-fe165165336a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:56.113971 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6eb50582-e244-4e64-a6a5-fe165165336a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:56.114752 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6eb50582-e244-4e64-a6a5-fe165165336a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:56.116624 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6eb50582-e244-4e64-a6a5-fe165165336a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:56.118482 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6eb50582-e244-4e64-a6a5-fe165165336a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:56.120795 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6eb50582-e244-4e64-a6a5-fe165165336a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:56.123354 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6eb50582-e244-4e64-a6a5-fe165165336a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:56.604716 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6eb50582-e244-4e64-a6a5-fe165165336a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:56.613222 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6eb50582-e244-4e64-a6a5-fe165165336a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1294 microversion: 2.1 time: 0.542071 Aug 30 01:16:56.628261 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 36/64] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:56 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1294 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:56.642893 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-51bef63e-c1cf-4dcd-a6d7-effad3d85d32 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:56.649819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-51bef63e-c1cf-4dcd-a6d7-effad3d85d32 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:56.670819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51bef63e-c1cf-4dcd-a6d7-effad3d85d32 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:56.671306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51bef63e-c1cf-4dcd-a6d7-effad3d85d32 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:56.677949 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51bef63e-c1cf-4dcd-a6d7-effad3d85d32 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:56.678732 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51bef63e-c1cf-4dcd-a6d7-effad3d85d32 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:56.679233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51bef63e-c1cf-4dcd-a6d7-effad3d85d32 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:56.688503 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51bef63e-c1cf-4dcd-a6d7-effad3d85d32 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:56.968345 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-33899995-cc2d-4520-b9ba-7d93479b8b00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:56.983700 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-33899995-cc2d-4520-b9ba-7d93479b8b00 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 2.011986 Aug 30 01:16:56.986636 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 29/65] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:54 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:16:57.156384 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-51bef63e-c1cf-4dcd-a6d7-effad3d85d32 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:57.171774 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-51bef63e-c1cf-4dcd-a6d7-effad3d85d32 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.541938 Aug 30 01:16:57.179243 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 37/66] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:56 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:57.660672 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-200671cf-d58a-4aae-867d-b3e940418524 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:57.661291 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-200671cf-d58a-4aae-867d-b3e940418524 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:57.674511 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-200671cf-d58a-4aae-867d-b3e940418524 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:57.675001 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-200671cf-d58a-4aae-867d-b3e940418524 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:57.675505 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-200671cf-d58a-4aae-867d-b3e940418524 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:57.676266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-200671cf-d58a-4aae-867d-b3e940418524 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:57.676726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-200671cf-d58a-4aae-867d-b3e940418524 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:57.685813 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-200671cf-d58a-4aae-867d-b3e940418524 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:58.019206 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9e709af1-7385-4e48-9d6c-336c040c1ad1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:58.019984 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9e709af1-7385-4e48-9d6c-336c040c1ad1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:58.046166 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9e709af1-7385-4e48-9d6c-336c040c1ad1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:58.047066 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9e709af1-7385-4e48-9d6c-336c040c1ad1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:58.047066 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9e709af1-7385-4e48-9d6c-336c040c1ad1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:58.047778 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9e709af1-7385-4e48-9d6c-336c040c1ad1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:58.048326 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9e709af1-7385-4e48-9d6c-336c040c1ad1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:58.048764 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9e709af1-7385-4e48-9d6c-336c040c1ad1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:58.798717 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-200671cf-d58a-4aae-867d-b3e940418524 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:58.828546 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-200671cf-d58a-4aae-867d-b3e940418524 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 1.167218 Aug 30 01:16:58.846850 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 30/67] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:57 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:58.846850 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b473ebee-5909-4cf7-89bb-9c20568dcd45 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:58.846850 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b473ebee-5909-4cf7-89bb-9c20568dcd45 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:58.877807 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b473ebee-5909-4cf7-89bb-9c20568dcd45 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:58.879742 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b473ebee-5909-4cf7-89bb-9c20568dcd45 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:58.880264 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b473ebee-5909-4cf7-89bb-9c20568dcd45 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:58.885096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b473ebee-5909-4cf7-89bb-9c20568dcd45 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:58.887066 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b473ebee-5909-4cf7-89bb-9c20568dcd45 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:58.892764 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b473ebee-5909-4cf7-89bb-9c20568dcd45 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:58.995637 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9e709af1-7385-4e48-9d6c-336c040c1ad1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:59.015710 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9e709af1-7385-4e48-9d6c-336c040c1ad1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 1.012544 Aug 30 01:16:59.040108 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 38/68] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:58 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:59.079503 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-39113ca3-fbcb-42f9-925e-5db897589ee5 req-b4130462-429b-4ac9-99b7-218ea4ed976b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dda66a0c-f0fc-4e46-a037-960b2879678a", "tag": "3eabc9c9-0fec-47b6-9f67-0d6d39d99fb5"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:59.114428 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-39113ca3-fbcb-42f9-925e-5db897589ee5 req-b4130462-429b-4ac9-99b7-218ea4ed976b service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:59.117456 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-39113ca3-fbcb-42f9-925e-5db897589ee5 req-b4130462-429b-4ac9-99b7-218ea4ed976b service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:59.120376 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-39113ca3-fbcb-42f9-925e-5db897589ee5 req-b4130462-429b-4ac9-99b7-218ea4ed976b service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:59.170327 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-39113ca3-fbcb-42f9-925e-5db897589ee5 req-b4130462-429b-4ac9-99b7-218ea4ed976b service nova] Creating event network-changed:3eabc9c9-0fec-47b6-9f67-0d6d39d99fb5 for instance dda66a0c-f0fc-4e46-a037-960b2879678a on hv-cinder-81514 Aug 30 01:16:59.199240 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-39113ca3-fbcb-42f9-925e-5db897589ee5 req-b4130462-429b-4ac9-99b7-218ea4ed976b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133934 Aug 30 01:16:59.202047 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 39/69] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:59.618382 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b473ebee-5909-4cf7-89bb-9c20568dcd45 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:59.629018 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b473ebee-5909-4cf7-89bb-9c20568dcd45 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.794564 Aug 30 01:16:59.639955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 31/70] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:58 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:59.861887 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-60b70d65-2192-4a96-a437-0fbd2d2f81a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:59.864923 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-60b70d65-2192-4a96-a437-0fbd2d2f81a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:59.894082 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60b70d65-2192-4a96-a437-0fbd2d2f81a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:59.895428 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60b70d65-2192-4a96-a437-0fbd2d2f81a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:59.917774 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60b70d65-2192-4a96-a437-0fbd2d2f81a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:59.918612 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60b70d65-2192-4a96-a437-0fbd2d2f81a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:59.919146 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60b70d65-2192-4a96-a437-0fbd2d2f81a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:59.919746 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60b70d65-2192-4a96-a437-0fbd2d2f81a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:00.026633 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:00.057595 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4c8c269c-867f-4358-9986-f90ad178980d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:00.065590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4c8c269c-867f-4358-9986-f90ad178980d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:00.099585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c8c269c-867f-4358-9986-f90ad178980d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:00.101717 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c8c269c-867f-4358-9986-f90ad178980d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:00.107264 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c8c269c-867f-4358-9986-f90ad178980d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:00.108288 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c8c269c-867f-4358-9986-f90ad178980d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:00.112723 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c8c269c-867f-4358-9986-f90ad178980d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:00.117060 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c8c269c-867f-4358-9986-f90ad178980d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:01.287339 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4c8c269c-867f-4358-9986-f90ad178980d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:01.305385 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4c8c269c-867f-4358-9986-f90ad178980d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 1.248802 Aug 30 01:17:01.307254 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 32/71] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:00 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:01.327480 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-76410969-6b9c-48ad-b063-0cb8ab592372 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:01.329892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-76410969-6b9c-48ad-b063-0cb8ab592372 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:01.342974 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:01.346426 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76410969-6b9c-48ad-b063-0cb8ab592372 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:01.346933 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76410969-6b9c-48ad-b063-0cb8ab592372 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:01.347371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76410969-6b9c-48ad-b063-0cb8ab592372 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:01.351230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76410969-6b9c-48ad-b063-0cb8ab592372 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:01.351964 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76410969-6b9c-48ad-b063-0cb8ab592372 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:01.352559 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76410969-6b9c-48ad-b063-0cb8ab592372 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:01.677883 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-76410969-6b9c-48ad-b063-0cb8ab592372 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:01.689875 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-76410969-6b9c-48ad-b063-0cb8ab592372 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.380928 Aug 30 01:17:01.690947 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 33/72] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:01 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:02.032418 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-eb6a9e30-b747-4ef1-9d4c-97b3fd93ecd1 req-8ba749b5-8473-4297-ad9f-b960107a0ccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ae258e-1465-4b2c-be83-77db7a339adf", "tag": "dc2b0901-0f5c-49be-b9ac-d776a11996b4"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:02.087767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-eb6a9e30-b747-4ef1-9d4c-97b3fd93ecd1 req-8ba749b5-8473-4297-ad9f-b960107a0ccc service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:02.091234 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-eb6a9e30-b747-4ef1-9d4c-97b3fd93ecd1 req-8ba749b5-8473-4297-ad9f-b960107a0ccc service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:02.091710 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-eb6a9e30-b747-4ef1-9d4c-97b3fd93ecd1 req-8ba749b5-8473-4297-ad9f-b960107a0ccc service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:02.172358 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-60b70d65-2192-4a96-a437-0fbd2d2f81a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:02.202143 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-60b70d65-2192-4a96-a437-0fbd2d2f81a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 2.348157 Aug 30 01:17:02.217424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 40/73] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:59 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:02.244338 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-eb6a9e30-b747-4ef1-9d4c-97b3fd93ecd1 req-8ba749b5-8473-4297-ad9f-b960107a0ccc service nova] Creating event network-changed:dc2b0901-0f5c-49be-b9ac-d776a11996b4 for instance f3ae258e-1465-4b2c-be83-77db7a339adf on hv-cinder-81514 Aug 30 01:17:02.244338 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-eb6a9e30-b747-4ef1-9d4c-97b3fd93ecd1 req-8ba749b5-8473-4297-ad9f-b960107a0ccc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120705) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 01:17:02.244602 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-eb6a9e30-b747-4ef1-9d4c-97b3fd93ecd1 req-8ba749b5-8473-4297-ad9f-b960107a0ccc service nova] Acquired lock "compute-rpcapi-router" {{(pid=120705) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 01:17:02.245635 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-568a3e0c-2f46-48d3-8798-89951cb46062 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:02.246116 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-568a3e0c-2f46-48d3-8798-89951cb46062 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:02.246570 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-568a3e0c-2f46-48d3-8798-89951cb46062 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:02.251503 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-568a3e0c-2f46-48d3-8798-89951cb46062 None None] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:02.254648 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-568a3e0c-2f46-48d3-8798-89951cb46062 None None] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:02.255676 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-568a3e0c-2f46-48d3-8798-89951cb46062 None None] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:02.290046 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.compute.rpcapi [None req-568a3e0c-2f46-48d3-8798-89951cb46062 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 01:17:02.299470 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-568a3e0c-2f46-48d3-8798-89951cb46062 None None] Releasing lock "compute-rpcapi-router" {{(pid=120705) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 01:17:02.328653 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-38880d54-7a13-4fa0-b3a7-4b8c43bee39f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:02.329459 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-38880d54-7a13-4fa0-b3a7-4b8c43bee39f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:02.343737 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-38880d54-7a13-4fa0-b3a7-4b8c43bee39f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:02.347784 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-568a3e0c-2f46-48d3-8798-89951cb46062 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.653386 Aug 30 01:17:02.350334 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-38880d54-7a13-4fa0-b3a7-4b8c43bee39f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:02.358814 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 34/74] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:02.359288 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-38880d54-7a13-4fa0-b3a7-4b8c43bee39f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:02.360677 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-38880d54-7a13-4fa0-b3a7-4b8c43bee39f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:02.364733 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-38880d54-7a13-4fa0-b3a7-4b8c43bee39f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:02.365754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-38880d54-7a13-4fa0-b3a7-4b8c43bee39f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:02.712649 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cab4f57f-26d7-425f-bf99-a8689a2993f8 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:02.713621 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cab4f57f-26d7-425f-bf99-a8689a2993f8 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:02.746409 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cab4f57f-26d7-425f-bf99-a8689a2993f8 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:02.752672 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cab4f57f-26d7-425f-bf99-a8689a2993f8 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:02.754969 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cab4f57f-26d7-425f-bf99-a8689a2993f8 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:02.757222 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cab4f57f-26d7-425f-bf99-a8689a2993f8 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:02.761285 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cab4f57f-26d7-425f-bf99-a8689a2993f8 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:02.763388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cab4f57f-26d7-425f-bf99-a8689a2993f8 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:03.345775 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-cab4f57f-26d7-425f-bf99-a8689a2993f8 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:03.366371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cab4f57f-26d7-425f-bf99-a8689a2993f8 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.658916 Aug 30 01:17:03.366959 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 35/75] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:02 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:03.385991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0e87fbe2-437c-4256-8adc-24213b70cffb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:03.386641 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0e87fbe2-437c-4256-8adc-24213b70cffb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:03.403586 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0e87fbe2-437c-4256-8adc-24213b70cffb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:03.404117 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0e87fbe2-437c-4256-8adc-24213b70cffb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:03.405415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0e87fbe2-437c-4256-8adc-24213b70cffb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:03.406153 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0e87fbe2-437c-4256-8adc-24213b70cffb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:03.406612 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0e87fbe2-437c-4256-8adc-24213b70cffb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:03.407039 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0e87fbe2-437c-4256-8adc-24213b70cffb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:03.809504 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-38880d54-7a13-4fa0-b3a7-4b8c43bee39f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:03.827429 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-38880d54-7a13-4fa0-b3a7-4b8c43bee39f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 1.503072 Aug 30 01:17:03.828837 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 41/76] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:02 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:03.924722 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0e87fbe2-437c-4256-8adc-24213b70cffb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:03.936249 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0e87fbe2-437c-4256-8adc-24213b70cffb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 0.567985 Aug 30 01:17:03.950091 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 36/77] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:03 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:04.403467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-13859b86-d7c9-4359-a7d4-a598fed7f19a req-d7b6a45c-7ebc-4d79-ab7e-08053c5a502a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6657e20f-b2a0-4f01-9dca-fd276792dc73", "tag": "21bbf672-b4dc-4800-a86f-8518de16fcca"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:04.412803 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2c206d74-af74-4056-a054-a3f337cc0871 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:04.417026 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2c206d74-af74-4056-a054-a3f337cc0871 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:04.423336 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-13859b86-d7c9-4359-a7d4-a598fed7f19a req-d7b6a45c-7ebc-4d79-ab7e-08053c5a502a service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:04.424086 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-13859b86-d7c9-4359-a7d4-a598fed7f19a req-d7b6a45c-7ebc-4d79-ab7e-08053c5a502a service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:04.424666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-13859b86-d7c9-4359-a7d4-a598fed7f19a req-d7b6a45c-7ebc-4d79-ab7e-08053c5a502a service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:04.439175 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-13859b86-d7c9-4359-a7d4-a598fed7f19a req-d7b6a45c-7ebc-4d79-ab7e-08053c5a502a service nova] Creating event network-changed:21bbf672-b4dc-4800-a86f-8518de16fcca for instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 on hv-cinder-81514 Aug 30 01:17:04.443853 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2c206d74-af74-4056-a054-a3f337cc0871 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:04.446617 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2c206d74-af74-4056-a054-a3f337cc0871 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:04.446837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-13859b86-d7c9-4359-a7d4-a598fed7f19a req-d7b6a45c-7ebc-4d79-ab7e-08053c5a502a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046864 Aug 30 01:17:04.447192 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2c206d74-af74-4056-a054-a3f337cc0871 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:04.447926 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 37/78] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:17:04.450099 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2c206d74-af74-4056-a054-a3f337cc0871 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:04.451554 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2c206d74-af74-4056-a054-a3f337cc0871 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:04.452947 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2c206d74-af74-4056-a054-a3f337cc0871 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:04.731106 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2c206d74-af74-4056-a054-a3f337cc0871 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:04.744570 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2c206d74-af74-4056-a054-a3f337cc0871 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.349291 Aug 30 01:17:04.745843 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 42/79] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:04 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:04.862049 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7046d040-0994-49e3-b77e-e7fdca0f189c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:04.864830 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7046d040-0994-49e3-b77e-e7fdca0f189c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:04.877019 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7046d040-0994-49e3-b77e-e7fdca0f189c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:04.878501 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7046d040-0994-49e3-b77e-e7fdca0f189c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:04.879394 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7046d040-0994-49e3-b77e-e7fdca0f189c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:04.880640 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7046d040-0994-49e3-b77e-e7fdca0f189c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:04.882261 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7046d040-0994-49e3-b77e-e7fdca0f189c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:04.882920 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7046d040-0994-49e3-b77e-e7fdca0f189c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:04.962822 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0689a22e-9a1a-431a-8752-ceb267145dc2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:04.964975 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0689a22e-9a1a-431a-8752-ceb267145dc2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:04.973749 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0689a22e-9a1a-431a-8752-ceb267145dc2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:04.974724 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0689a22e-9a1a-431a-8752-ceb267145dc2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:04.976318 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0689a22e-9a1a-431a-8752-ceb267145dc2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:04.977421 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0689a22e-9a1a-431a-8752-ceb267145dc2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:04.977984 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0689a22e-9a1a-431a-8752-ceb267145dc2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:04.982306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0689a22e-9a1a-431a-8752-ceb267145dc2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:05.104329 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7046d040-0994-49e3-b77e-e7fdca0f189c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:05.120055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7046d040-0994-49e3-b77e-e7fdca0f189c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.270612 Aug 30 01:17:05.120694 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 38/80] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:04 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:05.215164 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0689a22e-9a1a-431a-8752-ceb267145dc2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:05.234155 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0689a22e-9a1a-431a-8752-ceb267145dc2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 0.276990 Aug 30 01:17:05.248632 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 43/81] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:04 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:05.778371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b55c1266-8430-43ca-b129-0502e3c1532d tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:05.779128 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b55c1266-8430-43ca-b129-0502e3c1532d tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:05.791453 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b55c1266-8430-43ca-b129-0502e3c1532d tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:05.792317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b55c1266-8430-43ca-b129-0502e3c1532d tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:05.793091 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b55c1266-8430-43ca-b129-0502e3c1532d tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:05.794298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b55c1266-8430-43ca-b129-0502e3c1532d tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:05.794975 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b55c1266-8430-43ca-b129-0502e3c1532d tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:05.795652 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b55c1266-8430-43ca-b129-0502e3c1532d tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:06.056235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b55c1266-8430-43ca-b129-0502e3c1532d tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:06.075582 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b55c1266-8430-43ca-b129-0502e3c1532d tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.301118 Aug 30 01:17:06.078936 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 39/82] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:05 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:06.143116 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c6491db6-fc7f-40b4-8d47-369e8c37772d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:06.143960 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c6491db6-fc7f-40b4-8d47-369e8c37772d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:06.147263 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:06.150193 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:06.171250 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c6491db6-fc7f-40b4-8d47-369e8c37772d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:06.171927 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c6491db6-fc7f-40b4-8d47-369e8c37772d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:06.172976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c6491db6-fc7f-40b4-8d47-369e8c37772d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:06.174006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c6491db6-fc7f-40b4-8d47-369e8c37772d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:06.174631 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c6491db6-fc7f-40b4-8d47-369e8c37772d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:06.175213 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c6491db6-fc7f-40b4-8d47-369e8c37772d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:06.256077 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2084532b-84e0-474e-8144-6c2ef7f45b3c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:06.257311 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2084532b-84e0-474e-8144-6c2ef7f45b3c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:06.270315 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2084532b-84e0-474e-8144-6c2ef7f45b3c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:06.270982 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2084532b-84e0-474e-8144-6c2ef7f45b3c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:06.271559 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2084532b-84e0-474e-8144-6c2ef7f45b3c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:06.273192 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2084532b-84e0-474e-8144-6c2ef7f45b3c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:06.275937 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2084532b-84e0-474e-8144-6c2ef7f45b3c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:06.276608 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2084532b-84e0-474e-8144-6c2ef7f45b3c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:06.281389 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:06.372070 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c6491db6-fc7f-40b4-8d47-369e8c37772d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:06.381607 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c6491db6-fc7f-40b4-8d47-369e8c37772d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.243766 Aug 30 01:17:06.399861 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 44/83] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:06 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:06.444820 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2084532b-84e0-474e-8144-6c2ef7f45b3c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:06.457975 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2084532b-84e0-474e-8144-6c2ef7f45b3c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 0.205817 Aug 30 01:17:06.459037 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 40/84] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:06 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:07.105829 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cfb23a4f-4c79-4e42-8776-4a914916154c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:07.121643 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cfb23a4f-4c79-4e42-8776-4a914916154c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:07.133434 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfb23a4f-4c79-4e42-8776-4a914916154c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.135118 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfb23a4f-4c79-4e42-8776-4a914916154c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.137307 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfb23a4f-4c79-4e42-8776-4a914916154c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.140244 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfb23a4f-4c79-4e42-8776-4a914916154c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.141992 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfb23a4f-4c79-4e42-8776-4a914916154c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.143071 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfb23a4f-4c79-4e42-8776-4a914916154c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.403847 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-050f632b-b8ac-4a2b-a5b9-3f27fdfe9c53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:07.407299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-050f632b-b8ac-4a2b-a5b9-3f27fdfe9c53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:07.420308 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-050f632b-b8ac-4a2b-a5b9-3f27fdfe9c53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.421177 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-050f632b-b8ac-4a2b-a5b9-3f27fdfe9c53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.421896 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-050f632b-b8ac-4a2b-a5b9-3f27fdfe9c53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.423010 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-050f632b-b8ac-4a2b-a5b9-3f27fdfe9c53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.423730 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-050f632b-b8ac-4a2b-a5b9-3f27fdfe9c53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.424457 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-050f632b-b8ac-4a2b-a5b9-3f27fdfe9c53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.451001 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cfb23a4f-4c79-4e42-8776-4a914916154c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:07.466885 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cfb23a4f-4c79-4e42-8776-4a914916154c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.370469 Aug 30 01:17:07.472399 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 45/85] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:07 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:07.488497 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-31690ae1-529a-4334-95cd-1018d3397150 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:07.489599 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-31690ae1-529a-4334-95cd-1018d3397150 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:07.505837 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-31690ae1-529a-4334-95cd-1018d3397150 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.507433 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-31690ae1-529a-4334-95cd-1018d3397150 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.508697 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-31690ae1-529a-4334-95cd-1018d3397150 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.509766 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-31690ae1-529a-4334-95cd-1018d3397150 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.510520 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-31690ae1-529a-4334-95cd-1018d3397150 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.516904 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-31690ae1-529a-4334-95cd-1018d3397150 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.900328 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-050f632b-b8ac-4a2b-a5b9-3f27fdfe9c53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:07.910866 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-050f632b-b8ac-4a2b-a5b9-3f27fdfe9c53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.511587 Aug 30 01:17:07.916591 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 41/86] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:07 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:08.215757 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-31690ae1-529a-4334-95cd-1018d3397150 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:08.234273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-31690ae1-529a-4334-95cd-1018d3397150 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 0.755205 Aug 30 01:17:08.240336 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 46/87] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:07 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:08.498263 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e1e65346-2db2-4625-81ab-ec2afb75fdcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:08.499637 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e1e65346-2db2-4625-81ab-ec2afb75fdcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:08.514651 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e1e65346-2db2-4625-81ab-ec2afb75fdcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:08.515647 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e1e65346-2db2-4625-81ab-ec2afb75fdcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:08.516277 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e1e65346-2db2-4625-81ab-ec2afb75fdcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:08.529139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e1e65346-2db2-4625-81ab-ec2afb75fdcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:08.530017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e1e65346-2db2-4625-81ab-ec2afb75fdcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:08.530755 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e1e65346-2db2-4625-81ab-ec2afb75fdcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:08.909539 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e1e65346-2db2-4625-81ab-ec2afb75fdcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:08.918125 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e1e65346-2db2-4625-81ab-ec2afb75fdcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.432594 Aug 30 01:17:08.921019 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 42/88] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:08 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:08.941478 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-80f8b565-1a41-4730-8704-fc23870eb545 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:08.942207 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-80f8b565-1a41-4730-8704-fc23870eb545 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:08.951735 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80f8b565-1a41-4730-8704-fc23870eb545 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:08.952801 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80f8b565-1a41-4730-8704-fc23870eb545 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:08.953463 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80f8b565-1a41-4730-8704-fc23870eb545 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:08.954434 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80f8b565-1a41-4730-8704-fc23870eb545 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:08.955047 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80f8b565-1a41-4730-8704-fc23870eb545 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:08.955615 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80f8b565-1a41-4730-8704-fc23870eb545 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:09.142801 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-80f8b565-1a41-4730-8704-fc23870eb545 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:09.153063 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-80f8b565-1a41-4730-8704-fc23870eb545 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.218053 Aug 30 01:17:09.153853 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 47/89] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:08 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:09.266652 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c1e46315-31e9-4dbd-8b1d-6a4b3bde385d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:09.267370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c1e46315-31e9-4dbd-8b1d-6a4b3bde385d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:09.282461 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c1e46315-31e9-4dbd-8b1d-6a4b3bde385d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:09.282958 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c1e46315-31e9-4dbd-8b1d-6a4b3bde385d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:09.283566 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c1e46315-31e9-4dbd-8b1d-6a4b3bde385d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:09.284743 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c1e46315-31e9-4dbd-8b1d-6a4b3bde385d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:09.285315 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c1e46315-31e9-4dbd-8b1d-6a4b3bde385d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:09.285710 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c1e46315-31e9-4dbd-8b1d-6a4b3bde385d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:09.528801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c1e46315-31e9-4dbd-8b1d-6a4b3bde385d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:09.538780 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c1e46315-31e9-4dbd-8b1d-6a4b3bde385d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 0.275484 Aug 30 01:17:09.554462 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 43/90] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:09 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:09.950616 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bdd1c3ba-7ff3-441b-a0c9-655e882af108 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:09.953723 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bdd1c3ba-7ff3-441b-a0c9-655e882af108 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:09.968664 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bdd1c3ba-7ff3-441b-a0c9-655e882af108 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:09.970572 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bdd1c3ba-7ff3-441b-a0c9-655e882af108 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:09.975873 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bdd1c3ba-7ff3-441b-a0c9-655e882af108 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:09.977924 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bdd1c3ba-7ff3-441b-a0c9-655e882af108 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:09.979704 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bdd1c3ba-7ff3-441b-a0c9-655e882af108 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:09.980327 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bdd1c3ba-7ff3-441b-a0c9-655e882af108 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:10.248674 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-8f9dbd5b-ed14-4609-baa5-c5fe1968c486 req-5a596dff-9c60-4bb1-953a-960ec46454de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ae258e-1465-4b2c-be83-77db7a339adf", "name": "network-vif-plugged", "status": "completed", "tag": "dc2b0901-0f5c-49be-b9ac-d776a11996b4"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:10.268472 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-8f9dbd5b-ed14-4609-baa5-c5fe1968c486 req-5a596dff-9c60-4bb1-953a-960ec46454de service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:10.270926 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-8f9dbd5b-ed14-4609-baa5-c5fe1968c486 req-5a596dff-9c60-4bb1-953a-960ec46454de service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:10.271371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-8f9dbd5b-ed14-4609-baa5-c5fe1968c486 req-5a596dff-9c60-4bb1-953a-960ec46454de service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:10.308414 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-8f9dbd5b-ed14-4609-baa5-c5fe1968c486 req-5a596dff-9c60-4bb1-953a-960ec46454de service nova] Creating event network-vif-plugged:dc2b0901-0f5c-49be-b9ac-d776a11996b4 for instance f3ae258e-1465-4b2c-be83-77db7a339adf on hv-cinder-81514 Aug 30 01:17:10.343641 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-8f9dbd5b-ed14-4609-baa5-c5fe1968c486 req-5a596dff-9c60-4bb1-953a-960ec46454de service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232089 Aug 30 01:17:10.346124 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 44/91] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:17:10.359880 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7aa1fc7d-8486-4d76-8f37-25853e335e9a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:10.360967 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7aa1fc7d-8486-4d76-8f37-25853e335e9a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:10.374310 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7aa1fc7d-8486-4d76-8f37-25853e335e9a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:10.379917 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7aa1fc7d-8486-4d76-8f37-25853e335e9a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:10.380495 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7aa1fc7d-8486-4d76-8f37-25853e335e9a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:10.382015 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7aa1fc7d-8486-4d76-8f37-25853e335e9a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:10.382494 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7aa1fc7d-8486-4d76-8f37-25853e335e9a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:10.382923 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7aa1fc7d-8486-4d76-8f37-25853e335e9a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:10.550735 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bdd1c3ba-7ff3-441b-a0c9-655e882af108 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:10.565623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bdd1c3ba-7ff3-441b-a0c9-655e882af108 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.619874 Aug 30 01:17:10.570217 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 48/92] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:09 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:10.587862 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9ca854ea-a8b7-49fe-b421-1b6330d1243e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:10.589045 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9ca854ea-a8b7-49fe-b421-1b6330d1243e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:10.621713 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ca854ea-a8b7-49fe-b421-1b6330d1243e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:10.622558 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ca854ea-a8b7-49fe-b421-1b6330d1243e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:10.626004 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ca854ea-a8b7-49fe-b421-1b6330d1243e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:10.627197 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ca854ea-a8b7-49fe-b421-1b6330d1243e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:10.632710 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ca854ea-a8b7-49fe-b421-1b6330d1243e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:10.633462 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ca854ea-a8b7-49fe-b421-1b6330d1243e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:10.866341 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7aa1fc7d-8486-4d76-8f37-25853e335e9a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:10.882212 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7aa1fc7d-8486-4d76-8f37-25853e335e9a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.534631 Aug 30 01:17:10.889508 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 45/93] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:10 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:11.031938 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9ca854ea-a8b7-49fe-b421-1b6330d1243e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:11.044441 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9ca854ea-a8b7-49fe-b421-1b6330d1243e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 0.470159 Aug 30 01:17:11.048959 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 49/94] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:10 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:11.587376 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6f52c1f9-7db2-4251-8ab2-ce2531763449 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:11.588104 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6f52c1f9-7db2-4251-8ab2-ce2531763449 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:11.597707 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f52c1f9-7db2-4251-8ab2-ce2531763449 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:11.598406 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f52c1f9-7db2-4251-8ab2-ce2531763449 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:11.599506 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f52c1f9-7db2-4251-8ab2-ce2531763449 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:11.609244 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f52c1f9-7db2-4251-8ab2-ce2531763449 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:11.609758 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f52c1f9-7db2-4251-8ab2-ce2531763449 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:11.610203 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f52c1f9-7db2-4251-8ab2-ce2531763449 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:11.906218 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6f52c1f9-7db2-4251-8ab2-ce2531763449 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:11.915677 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-02931cb7-a899-4e66-bbd5-baadd608adf0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:11.916958 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-02931cb7-a899-4e66-bbd5-baadd608adf0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:11.929781 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02931cb7-a899-4e66-bbd5-baadd608adf0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:11.930788 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02931cb7-a899-4e66-bbd5-baadd608adf0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:11.931321 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6f52c1f9-7db2-4251-8ab2-ce2531763449 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.346130 Aug 30 01:17:11.932692 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02931cb7-a899-4e66-bbd5-baadd608adf0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:11.933734 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02931cb7-a899-4e66-bbd5-baadd608adf0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:11.934985 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02931cb7-a899-4e66-bbd5-baadd608adf0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:11.935583 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02931cb7-a899-4e66-bbd5-baadd608adf0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:11.947972 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 46/95] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:11 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:12.069639 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-144fcbe3-bd71-41d9-aaa9-f3b62a28dc25 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:12.070335 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-144fcbe3-bd71-41d9-aaa9-f3b62a28dc25 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:12.078579 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-144fcbe3-bd71-41d9-aaa9-f3b62a28dc25 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:12.079094 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-144fcbe3-bd71-41d9-aaa9-f3b62a28dc25 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:12.079536 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-144fcbe3-bd71-41d9-aaa9-f3b62a28dc25 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:12.081149 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-144fcbe3-bd71-41d9-aaa9-f3b62a28dc25 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:12.081608 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-144fcbe3-bd71-41d9-aaa9-f3b62a28dc25 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:12.082029 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-144fcbe3-bd71-41d9-aaa9-f3b62a28dc25 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:12.153304 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-02931cb7-a899-4e66-bbd5-baadd608adf0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:12.163244 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-02931cb7-a899-4e66-bbd5-baadd608adf0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.252489 Aug 30 01:17:12.164489 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 50/96] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:11 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:12.282087 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:12.325906 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-144fcbe3-bd71-41d9-aaa9-f3b62a28dc25 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:12.340591 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-144fcbe3-bd71-41d9-aaa9-f3b62a28dc25 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 0.275018 Aug 30 01:17:12.341836 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 47/97] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:12 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:12.395060 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-10025202-bd15-4639-80f4-b3cff13d8179 req-22a90deb-d28a-495f-bdd8-d61a1834f022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26186b86-98dd-4907-8665-3358fa62eb1e", "name": "network-vif-plugged", "status": "completed", "tag": "732b6f50-130f-420b-8b3a-711de6b71f4a"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:12.406007 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-10025202-bd15-4639-80f4-b3cff13d8179 req-22a90deb-d28a-495f-bdd8-d61a1834f022 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:12.406470 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-10025202-bd15-4639-80f4-b3cff13d8179 req-22a90deb-d28a-495f-bdd8-d61a1834f022 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:12.407092 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-10025202-bd15-4639-80f4-b3cff13d8179 req-22a90deb-d28a-495f-bdd8-d61a1834f022 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:12.421322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-10025202-bd15-4639-80f4-b3cff13d8179 req-22a90deb-d28a-495f-bdd8-d61a1834f022 service nova] Creating event network-vif-plugged:732b6f50-130f-420b-8b3a-711de6b71f4a for instance 26186b86-98dd-4907-8665-3358fa62eb1e on hv-cinder-81514 Aug 30 01:17:12.428865 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-10025202-bd15-4639-80f4-b3cff13d8179 req-22a90deb-d28a-495f-bdd8-d61a1834f022 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036599 Aug 30 01:17:12.429378 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 51/98] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:12.955541 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d5b13d93-e6a0-404a-821d-ee44b0631ccc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:12.955541 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d5b13d93-e6a0-404a-821d-ee44b0631ccc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:12.966437 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5b13d93-e6a0-404a-821d-ee44b0631ccc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:12.966437 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5b13d93-e6a0-404a-821d-ee44b0631ccc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:12.966437 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5b13d93-e6a0-404a-821d-ee44b0631ccc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:12.966437 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5b13d93-e6a0-404a-821d-ee44b0631ccc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:12.966918 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5b13d93-e6a0-404a-821d-ee44b0631ccc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:12.966918 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5b13d93-e6a0-404a-821d-ee44b0631ccc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:13.181987 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d5b13d93-e6a0-404a-821d-ee44b0631ccc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:13.191588 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b380992f-d01b-4d6a-99d9-9feebfa09db7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:13.195976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b380992f-d01b-4d6a-99d9-9feebfa09db7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:13.198500 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d5b13d93-e6a0-404a-821d-ee44b0631ccc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.247458 Aug 30 01:17:13.199110 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 48/99] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:12 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:13.239635 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b380992f-d01b-4d6a-99d9-9feebfa09db7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:13.241117 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b380992f-d01b-4d6a-99d9-9feebfa09db7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:13.241889 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b380992f-d01b-4d6a-99d9-9feebfa09db7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:13.243583 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b380992f-d01b-4d6a-99d9-9feebfa09db7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:13.244704 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b380992f-d01b-4d6a-99d9-9feebfa09db7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:13.246224 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b380992f-d01b-4d6a-99d9-9feebfa09db7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:13.377966 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-daab713e-e159-442f-a585-cd6ce2ab9170 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:13.378964 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-daab713e-e159-442f-a585-cd6ce2ab9170 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:13.395449 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-daab713e-e159-442f-a585-cd6ce2ab9170 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:13.397727 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-daab713e-e159-442f-a585-cd6ce2ab9170 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:13.398599 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-daab713e-e159-442f-a585-cd6ce2ab9170 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:13.400166 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-daab713e-e159-442f-a585-cd6ce2ab9170 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:13.401229 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-daab713e-e159-442f-a585-cd6ce2ab9170 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:13.402743 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-daab713e-e159-442f-a585-cd6ce2ab9170 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:13.534261 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b380992f-d01b-4d6a-99d9-9feebfa09db7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:13.550463 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b380992f-d01b-4d6a-99d9-9feebfa09db7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.363983 Aug 30 01:17:13.551425 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 52/100] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:13 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:13.890695 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-daab713e-e159-442f-a585-cd6ce2ab9170 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:13.900597 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-daab713e-e159-442f-a585-cd6ce2ab9170 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 0.530656 Aug 30 01:17:13.901186 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 49/101] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:13 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:14.232209 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7e4ea44e-c263-4da9-9a72-c87c56a53426 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:14.233468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7e4ea44e-c263-4da9-9a72-c87c56a53426 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:14.242760 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e4ea44e-c263-4da9-9a72-c87c56a53426 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:14.243660 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e4ea44e-c263-4da9-9a72-c87c56a53426 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:14.244316 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e4ea44e-c263-4da9-9a72-c87c56a53426 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:14.245251 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e4ea44e-c263-4da9-9a72-c87c56a53426 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:14.245913 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e4ea44e-c263-4da9-9a72-c87c56a53426 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:14.246782 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e4ea44e-c263-4da9-9a72-c87c56a53426 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:14.486244 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7e4ea44e-c263-4da9-9a72-c87c56a53426 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:14.500232 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7e4ea44e-c263-4da9-9a72-c87c56a53426 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.274176 Aug 30 01:17:14.501502 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 53/102] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:14 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:14.585548 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f8550e11-5794-4060-88c7-daf08996e5b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:14.587715 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f8550e11-5794-4060-88c7-daf08996e5b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:14.602623 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f8550e11-5794-4060-88c7-daf08996e5b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:14.603572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f8550e11-5794-4060-88c7-daf08996e5b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:14.606550 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f8550e11-5794-4060-88c7-daf08996e5b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:14.607401 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f8550e11-5794-4060-88c7-daf08996e5b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:14.610417 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f8550e11-5794-4060-88c7-daf08996e5b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:14.612255 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f8550e11-5794-4060-88c7-daf08996e5b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:14.942486 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4275ecd6-e951-40c2-b49f-64e4b4502f8f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:14.947963 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4275ecd6-e951-40c2-b49f-64e4b4502f8f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:14.984457 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4275ecd6-e951-40c2-b49f-64e4b4502f8f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:14.985679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4275ecd6-e951-40c2-b49f-64e4b4502f8f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:14.986840 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4275ecd6-e951-40c2-b49f-64e4b4502f8f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:14.988603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4275ecd6-e951-40c2-b49f-64e4b4502f8f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:14.989580 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4275ecd6-e951-40c2-b49f-64e4b4502f8f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:14.992705 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4275ecd6-e951-40c2-b49f-64e4b4502f8f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:15.011943 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f8550e11-5794-4060-88c7-daf08996e5b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:15.024940 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f8550e11-5794-4060-88c7-daf08996e5b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.445355 Aug 30 01:17:15.027440 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 50/103] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:14 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:15.032370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-99b45c5d-4837-450a-b6ae-60430bbadad5 req-eb5e246b-39de-4d26-abd0-cf83a4902f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda66a0c-f0fc-4e46-a037-960b2879678a", "name": "network-vif-plugged", "status": "completed", "tag": "3eabc9c9-0fec-47b6-9f67-0d6d39d99fb5"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:15.055614 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-99b45c5d-4837-450a-b6ae-60430bbadad5 req-eb5e246b-39de-4d26-abd0-cf83a4902f2e service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:15.056148 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-99b45c5d-4837-450a-b6ae-60430bbadad5 req-eb5e246b-39de-4d26-abd0-cf83a4902f2e service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:15.056593 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-99b45c5d-4837-450a-b6ae-60430bbadad5 req-eb5e246b-39de-4d26-abd0-cf83a4902f2e service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:15.082711 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-99b45c5d-4837-450a-b6ae-60430bbadad5 req-eb5e246b-39de-4d26-abd0-cf83a4902f2e service nova] Creating event network-vif-plugged:3eabc9c9-0fec-47b6-9f67-0d6d39d99fb5 for instance dda66a0c-f0fc-4e46-a037-960b2879678a on hv-cinder-81514 Aug 30 01:17:15.093511 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-99b45c5d-4837-450a-b6ae-60430bbadad5 req-eb5e246b-39de-4d26-abd0-cf83a4902f2e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064522 Aug 30 01:17:15.094793 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 51/104] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:15.294316 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4275ecd6-e951-40c2-b49f-64e4b4502f8f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:15.305794 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4275ecd6-e951-40c2-b49f-64e4b4502f8f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 0.371792 Aug 30 01:17:15.306972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 54/105] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:14 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:15.524414 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2734cfdd-3931-4741-9304-27c4d80360eb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:15.525151 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2734cfdd-3931-4741-9304-27c4d80360eb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:15.543202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2734cfdd-3931-4741-9304-27c4d80360eb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:15.543727 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2734cfdd-3931-4741-9304-27c4d80360eb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:15.547641 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2734cfdd-3931-4741-9304-27c4d80360eb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:15.548511 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2734cfdd-3931-4741-9304-27c4d80360eb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:15.549028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2734cfdd-3931-4741-9304-27c4d80360eb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:15.554727 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2734cfdd-3931-4741-9304-27c4d80360eb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:15.842349 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2734cfdd-3931-4741-9304-27c4d80360eb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:15.852363 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2734cfdd-3931-4741-9304-27c4d80360eb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.333920 Aug 30 01:17:15.866412 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 52/106] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:15 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:16.052419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f1d86f70-65e7-494e-93de-635a2968c486 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:16.053567 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f1d86f70-65e7-494e-93de-635a2968c486 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:16.060729 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1d86f70-65e7-494e-93de-635a2968c486 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.061510 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1d86f70-65e7-494e-93de-635a2968c486 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.062148 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1d86f70-65e7-494e-93de-635a2968c486 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:16.062850 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1d86f70-65e7-494e-93de-635a2968c486 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.063489 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1d86f70-65e7-494e-93de-635a2968c486 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.064183 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1d86f70-65e7-494e-93de-635a2968c486 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:16.221544 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f1d86f70-65e7-494e-93de-635a2968c486 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:16.233227 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f1d86f70-65e7-494e-93de-635a2968c486 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.182256 Aug 30 01:17:16.234738 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 55/107] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:16 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:16.343912 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8fcc48d0-2fff-4909-aa0d-0f9fdde0665f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:16.344953 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8fcc48d0-2fff-4909-aa0d-0f9fdde0665f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:16.352329 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8fcc48d0-2fff-4909-aa0d-0f9fdde0665f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.352912 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8fcc48d0-2fff-4909-aa0d-0f9fdde0665f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.353586 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8fcc48d0-2fff-4909-aa0d-0f9fdde0665f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:16.355185 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8fcc48d0-2fff-4909-aa0d-0f9fdde0665f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.355779 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8fcc48d0-2fff-4909-aa0d-0f9fdde0665f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.356425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8fcc48d0-2fff-4909-aa0d-0f9fdde0665f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:16.578202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8fcc48d0-2fff-4909-aa0d-0f9fdde0665f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:16.590033 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8fcc48d0-2fff-4909-aa0d-0f9fdde0665f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 0.250204 Aug 30 01:17:16.591534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 53/108] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:16 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:16.877280 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ea2d387a-3c05-4976-a1ad-92e96557f564 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:16.878310 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ea2d387a-3c05-4976-a1ad-92e96557f564 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:16.885144 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea2d387a-3c05-4976-a1ad-92e96557f564 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.885743 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea2d387a-3c05-4976-a1ad-92e96557f564 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.886263 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea2d387a-3c05-4976-a1ad-92e96557f564 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:16.887163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea2d387a-3c05-4976-a1ad-92e96557f564 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.887839 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea2d387a-3c05-4976-a1ad-92e96557f564 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.888373 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea2d387a-3c05-4976-a1ad-92e96557f564 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:17.040690 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ea2d387a-3c05-4976-a1ad-92e96557f564 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:17.048597 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ea2d387a-3c05-4976-a1ad-92e96557f564 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.175128 Aug 30 01:17:17.049165 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 56/109] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:16 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:17.200676 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-4cb65562-f82a-427f-8cd9-6b40b2612ec3 req-93188d99-e3e0-4193-a3b8-409e05c5d41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6657e20f-b2a0-4f01-9dca-fd276792dc73", "name": "network-vif-plugged", "status": "completed", "tag": "21bbf672-b4dc-4800-a86f-8518de16fcca"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:17.211090 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-4cb65562-f82a-427f-8cd9-6b40b2612ec3 req-93188d99-e3e0-4193-a3b8-409e05c5d41b service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:17.211577 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-4cb65562-f82a-427f-8cd9-6b40b2612ec3 req-93188d99-e3e0-4193-a3b8-409e05c5d41b service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:17.212025 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-4cb65562-f82a-427f-8cd9-6b40b2612ec3 req-93188d99-e3e0-4193-a3b8-409e05c5d41b service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:17.227939 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-4cb65562-f82a-427f-8cd9-6b40b2612ec3 req-93188d99-e3e0-4193-a3b8-409e05c5d41b service nova] Creating event network-vif-plugged:21bbf672-b4dc-4800-a86f-8518de16fcca for instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 on hv-cinder-81514 Aug 30 01:17:17.236675 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-4cb65562-f82a-427f-8cd9-6b40b2612ec3 req-93188d99-e3e0-4193-a3b8-409e05c5d41b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039957 Aug 30 01:17:17.241448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 54/110] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:17:17.250710 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-524e6ccc-c8d7-4712-ba4b-580078b93932 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:17.251380 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-524e6ccc-c8d7-4712-ba4b-580078b93932 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:17.258450 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-524e6ccc-c8d7-4712-ba4b-580078b93932 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:17.258939 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-524e6ccc-c8d7-4712-ba4b-580078b93932 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:17.259371 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-524e6ccc-c8d7-4712-ba4b-580078b93932 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:17.260097 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-524e6ccc-c8d7-4712-ba4b-580078b93932 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:17.260550 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-524e6ccc-c8d7-4712-ba4b-580078b93932 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:17.260974 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-524e6ccc-c8d7-4712-ba4b-580078b93932 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:17.457719 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-524e6ccc-c8d7-4712-ba4b-580078b93932 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:17.461934 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:17.469591 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-524e6ccc-c8d7-4712-ba4b-580078b93932 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.222546 Aug 30 01:17:17.469961 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 57/111] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:17 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:17.615973 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f2f9bc26-eb4b-4197-8d20-ca9dde378e04 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:17.616841 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f2f9bc26-eb4b-4197-8d20-ca9dde378e04 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:17.629584 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2f9bc26-eb4b-4197-8d20-ca9dde378e04 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:17.631543 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2f9bc26-eb4b-4197-8d20-ca9dde378e04 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:17.633629 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2f9bc26-eb4b-4197-8d20-ca9dde378e04 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:17.634568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2f9bc26-eb4b-4197-8d20-ca9dde378e04 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:17.635625 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2f9bc26-eb4b-4197-8d20-ca9dde378e04 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:17.637895 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2f9bc26-eb4b-4197-8d20-ca9dde378e04 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:18.016449 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f2f9bc26-eb4b-4197-8d20-ca9dde378e04 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:18.029938 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f2f9bc26-eb4b-4197-8d20-ca9dde378e04 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 0.420809 Aug 30 01:17:18.031100 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 55/112] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:17 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:18.078741 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-85248128-0934-4728-90ab-613aadd53289 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:18.079491 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-85248128-0934-4728-90ab-613aadd53289 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:18.094665 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-85248128-0934-4728-90ab-613aadd53289 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:18.095245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-85248128-0934-4728-90ab-613aadd53289 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:18.095639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-85248128-0934-4728-90ab-613aadd53289 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:18.097611 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-85248128-0934-4728-90ab-613aadd53289 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:18.098340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-85248128-0934-4728-90ab-613aadd53289 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:18.098776 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-85248128-0934-4728-90ab-613aadd53289 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:18.304784 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-85248128-0934-4728-90ab-613aadd53289 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:18.313960 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-85248128-0934-4728-90ab-613aadd53289 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1314 microversion: 2.1 time: 0.245892 Aug 30 01:17:18.315107 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 58/113] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:18 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:18.494247 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9578eba8-ec1f-4e3d-885b-96f956115b38 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:18.496064 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9578eba8-ec1f-4e3d-885b-96f956115b38 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:18.507880 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9578eba8-ec1f-4e3d-885b-96f956115b38 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:18.508416 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9578eba8-ec1f-4e3d-885b-96f956115b38 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:18.516317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9578eba8-ec1f-4e3d-885b-96f956115b38 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:18.517075 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9578eba8-ec1f-4e3d-885b-96f956115b38 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:18.517555 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9578eba8-ec1f-4e3d-885b-96f956115b38 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:18.518706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9578eba8-ec1f-4e3d-885b-96f956115b38 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:18.791885 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9578eba8-ec1f-4e3d-885b-96f956115b38 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:18.801259 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9578eba8-ec1f-4e3d-885b-96f956115b38 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.314043 Aug 30 01:17:18.816159 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 56/114] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:18 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:19.063437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3235bce8-5abe-41f8-a2c6-7393ec407482 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:19.065444 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3235bce8-5abe-41f8-a2c6-7393ec407482 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:19.075237 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3235bce8-5abe-41f8-a2c6-7393ec407482 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:19.075811 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3235bce8-5abe-41f8-a2c6-7393ec407482 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:19.076357 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3235bce8-5abe-41f8-a2c6-7393ec407482 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:19.077373 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3235bce8-5abe-41f8-a2c6-7393ec407482 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:19.078003 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3235bce8-5abe-41f8-a2c6-7393ec407482 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:19.078837 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3235bce8-5abe-41f8-a2c6-7393ec407482 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:19.261773 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3235bce8-5abe-41f8-a2c6-7393ec407482 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:19.269809 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3235bce8-5abe-41f8-a2c6-7393ec407482 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1362 microversion: 2.1 time: 0.218187 Aug 30 01:17:19.271289 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 59/115] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:19 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:19.336425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f42dba4c-5e9e-4d0a-b139-d948bc2269ed tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:19.337136 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f42dba4c-5e9e-4d0a-b139-d948bc2269ed tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:19.343481 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f42dba4c-5e9e-4d0a-b139-d948bc2269ed tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:19.344093 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f42dba4c-5e9e-4d0a-b139-d948bc2269ed tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:19.344704 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f42dba4c-5e9e-4d0a-b139-d948bc2269ed tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:19.345408 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f42dba4c-5e9e-4d0a-b139-d948bc2269ed tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:19.346066 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f42dba4c-5e9e-4d0a-b139-d948bc2269ed tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:19.346493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f42dba4c-5e9e-4d0a-b139-d948bc2269ed tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:19.540356 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f42dba4c-5e9e-4d0a-b139-d948bc2269ed tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:19.552038 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f42dba4c-5e9e-4d0a-b139-d948bc2269ed tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1501 microversion: 2.1 time: 0.219960 Aug 30 01:17:19.554079 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 57/116] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:19 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:19.826489 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c224a230-0079-4c6e-8758-f7bd1de214b0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:19.827260 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c224a230-0079-4c6e-8758-f7bd1de214b0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:19.835568 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c224a230-0079-4c6e-8758-f7bd1de214b0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:19.836487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c224a230-0079-4c6e-8758-f7bd1de214b0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:19.837085 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c224a230-0079-4c6e-8758-f7bd1de214b0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:19.838032 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c224a230-0079-4c6e-8758-f7bd1de214b0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:19.838765 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c224a230-0079-4c6e-8758-f7bd1de214b0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:19.839225 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c224a230-0079-4c6e-8758-f7bd1de214b0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:20.101944 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c224a230-0079-4c6e-8758-f7bd1de214b0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:20.124533 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c224a230-0079-4c6e-8758-f7bd1de214b0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.302348 Aug 30 01:17:20.125122 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 60/117] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:19 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:20.293205 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d4c31145-73d7-4333-b031-ee6d28aa4739 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:20.294135 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d4c31145-73d7-4333-b031-ee6d28aa4739 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:20.308852 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4c31145-73d7-4333-b031-ee6d28aa4739 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:20.309763 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4c31145-73d7-4333-b031-ee6d28aa4739 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:20.310602 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4c31145-73d7-4333-b031-ee6d28aa4739 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:20.311417 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4c31145-73d7-4333-b031-ee6d28aa4739 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:20.312093 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4c31145-73d7-4333-b031-ee6d28aa4739 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:20.312591 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4c31145-73d7-4333-b031-ee6d28aa4739 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:20.498789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d4c31145-73d7-4333-b031-ee6d28aa4739 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:20.503088 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:20.511077 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d4c31145-73d7-4333-b031-ee6d28aa4739 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1548 microversion: 2.1 time: 0.221890 Aug 30 01:17:20.512322 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 58/118] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:20 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1548 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:20.555842 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-68fe67f4-cf33-4ccb-bb2f-2cf2fe2b01c5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:20.557333 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-68fe67f4-cf33-4ccb-bb2f-2cf2fe2b01c5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:20.572403 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-68fe67f4-cf33-4ccb-bb2f-2cf2fe2b01c5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:20.573363 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-68fe67f4-cf33-4ccb-bb2f-2cf2fe2b01c5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:20.574427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-68fe67f4-cf33-4ccb-bb2f-2cf2fe2b01c5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:20.575909 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-68fe67f4-cf33-4ccb-bb2f-2cf2fe2b01c5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:20.576783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-68fe67f4-cf33-4ccb-bb2f-2cf2fe2b01c5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:20.577520 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-68fe67f4-cf33-4ccb-bb2f-2cf2fe2b01c5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:20.830693 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-68fe67f4-cf33-4ccb-bb2f-2cf2fe2b01c5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.283067 Aug 30 01:17:20.831640 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 61/119] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Aug 30 01:17:20 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/os-interface => generated 284 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:21.153769 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-710285e1-17a5-40a8-977d-e908647c2dbf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:21.155391 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-710285e1-17a5-40a8-977d-e908647c2dbf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:21.167154 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-710285e1-17a5-40a8-977d-e908647c2dbf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:21.167655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-710285e1-17a5-40a8-977d-e908647c2dbf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:21.168128 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-710285e1-17a5-40a8-977d-e908647c2dbf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:21.170411 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-710285e1-17a5-40a8-977d-e908647c2dbf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:21.171329 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-710285e1-17a5-40a8-977d-e908647c2dbf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:21.171923 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-710285e1-17a5-40a8-977d-e908647c2dbf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:21.208951 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9948a1ed-f78b-4f8f-b6dd-efbd7c73dcaf tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca266b49-1188-4888-a732-5c29aa4ab6b3"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:21.211648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9948a1ed-f78b-4f8f-b6dd-efbd7c73dcaf tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:21.218464 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9948a1ed-f78b-4f8f-b6dd-efbd7c73dcaf tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:21.219235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9948a1ed-f78b-4f8f-b6dd-efbd7c73dcaf tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:21.219953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9948a1ed-f78b-4f8f-b6dd-efbd7c73dcaf tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:21.220845 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9948a1ed-f78b-4f8f-b6dd-efbd7c73dcaf tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:21.221465 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9948a1ed-f78b-4f8f-b6dd-efbd7c73dcaf tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:21.222049 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9948a1ed-f78b-4f8f-b6dd-efbd7c73dcaf tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:21.535592 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-710285e1-17a5-40a8-977d-e908647c2dbf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:21.549060 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-710285e1-17a5-40a8-977d-e908647c2dbf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.405538 Aug 30 01:17:21.550655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 59/120] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:21 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:22.576781 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c98996d8-6608-47d8-ae4d-7a33f009c9a6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:22.578107 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c98996d8-6608-47d8-ae4d-7a33f009c9a6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:22.588724 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c98996d8-6608-47d8-ae4d-7a33f009c9a6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:22.589196 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c98996d8-6608-47d8-ae4d-7a33f009c9a6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:22.592064 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c98996d8-6608-47d8-ae4d-7a33f009c9a6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:22.593017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c98996d8-6608-47d8-ae4d-7a33f009c9a6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:22.593523 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c98996d8-6608-47d8-ae4d-7a33f009c9a6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:22.593939 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c98996d8-6608-47d8-ae4d-7a33f009c9a6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:22.811721 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c98996d8-6608-47d8-ae4d-7a33f009c9a6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:22.821002 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c98996d8-6608-47d8-ae4d-7a33f009c9a6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.247942 Aug 30 01:17:22.821709 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 60/121] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:22 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:22.826470 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-1a78dcbf-b59e-420b-9761-2e547c1ce947 req-91b62e10-2815-40fc-ab80-ba0208bc509a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6657e20f-b2a0-4f01-9dca-fd276792dc73", "tag": "21bbf672-b4dc-4800-a86f-8518de16fcca"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:22.838019 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1a78dcbf-b59e-420b-9761-2e547c1ce947 req-91b62e10-2815-40fc-ab80-ba0208bc509a service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:22.838999 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1a78dcbf-b59e-420b-9761-2e547c1ce947 req-91b62e10-2815-40fc-ab80-ba0208bc509a service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:22.839777 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1a78dcbf-b59e-420b-9761-2e547c1ce947 req-91b62e10-2815-40fc-ab80-ba0208bc509a service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:22.853265 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-1a78dcbf-b59e-420b-9761-2e547c1ce947 req-91b62e10-2815-40fc-ab80-ba0208bc509a service nova] Creating event network-changed:21bbf672-b4dc-4800-a86f-8518de16fcca for instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 on hv-cinder-81514 Aug 30 01:17:22.858815 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-1a78dcbf-b59e-420b-9761-2e547c1ce947 req-91b62e10-2815-40fc-ab80-ba0208bc509a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035435 Aug 30 01:17:22.859883 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 61/122] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:23.861750 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-344ee865-7f64-4972-a866-074cb254796c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:23.863790 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-344ee865-7f64-4972-a866-074cb254796c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:23.871520 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-344ee865-7f64-4972-a866-074cb254796c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:23.872306 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-344ee865-7f64-4972-a866-074cb254796c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:23.872745 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-344ee865-7f64-4972-a866-074cb254796c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:23.873460 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-344ee865-7f64-4972-a866-074cb254796c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:23.873922 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-344ee865-7f64-4972-a866-074cb254796c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:23.874349 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-344ee865-7f64-4972-a866-074cb254796c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:24.041658 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-344ee865-7f64-4972-a866-074cb254796c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:24.050425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-344ee865-7f64-4972-a866-074cb254796c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1322 microversion: 2.1 time: 0.196938 Aug 30 01:17:24.050993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 62/123] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:23 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:25.076715 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e340c060-f322-42dc-b71e-e7a2bffef1a7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:25.077435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e340c060-f322-42dc-b71e-e7a2bffef1a7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:25.084020 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e340c060-f322-42dc-b71e-e7a2bffef1a7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:25.084637 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e340c060-f322-42dc-b71e-e7a2bffef1a7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:25.085067 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e340c060-f322-42dc-b71e-e7a2bffef1a7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:25.085769 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e340c060-f322-42dc-b71e-e7a2bffef1a7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:25.086680 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e340c060-f322-42dc-b71e-e7a2bffef1a7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:25.086680 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e340c060-f322-42dc-b71e-e7a2bffef1a7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:25.286426 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e340c060-f322-42dc-b71e-e7a2bffef1a7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:25.296062 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e340c060-f322-42dc-b71e-e7a2bffef1a7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1516 microversion: 2.1 time: 0.223108 Aug 30 01:17:25.296647 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 63/124] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:25 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1516 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:25.322323 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4cbbc1a1-f56c-41f6-bf1d-1c740db298b2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:25.325052 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4cbbc1a1-f56c-41f6-bf1d-1c740db298b2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:25.331638 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4cbbc1a1-f56c-41f6-bf1d-1c740db298b2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:25.332160 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4cbbc1a1-f56c-41f6-bf1d-1c740db298b2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:25.332598 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4cbbc1a1-f56c-41f6-bf1d-1c740db298b2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:25.333551 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4cbbc1a1-f56c-41f6-bf1d-1c740db298b2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:25.333981 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4cbbc1a1-f56c-41f6-bf1d-1c740db298b2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:25.334403 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4cbbc1a1-f56c-41f6-bf1d-1c740db298b2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:25.405293 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-4cbbc1a1-f56c-41f6-bf1d-1c740db298b2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lazy-loading 'flavor' on Instance uuid dda66a0c-f0fc-4e46-a037-960b2879678a {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:17:25.555362 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4cbbc1a1-f56c-41f6-bf1d-1c740db298b2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "POST /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a/action" status: 200 len: 32 microversion: 2.1 time: 0.238197 Aug 30 01:17:25.555976 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 64/125] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:17:25 2022] POST /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a/action => generated 32 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:17:25.565915 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a9fdf666-b630-4a3b-8a9d-a64ce5b45698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:25.566607 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a9fdf666-b630-4a3b-8a9d-a64ce5b45698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:25.573975 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a9fdf666-b630-4a3b-8a9d-a64ce5b45698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:25.574217 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a9fdf666-b630-4a3b-8a9d-a64ce5b45698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:25.574555 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a9fdf666-b630-4a3b-8a9d-a64ce5b45698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:25.575249 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a9fdf666-b630-4a3b-8a9d-a64ce5b45698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:25.575778 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a9fdf666-b630-4a3b-8a9d-a64ce5b45698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:25.576143 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a9fdf666-b630-4a3b-8a9d-a64ce5b45698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:25.755595 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a9fdf666-b630-4a3b-8a9d-a64ce5b45698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:25.764714 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a9fdf666-b630-4a3b-8a9d-a64ce5b45698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.202820 Aug 30 01:17:25.765838 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 65/126] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:25 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:26.789081 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4d4be5e5-9357-4555-84a7-940ce0c8edd1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:26.789712 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4d4be5e5-9357-4555-84a7-940ce0c8edd1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:26.795827 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d4be5e5-9357-4555-84a7-940ce0c8edd1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:26.796349 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d4be5e5-9357-4555-84a7-940ce0c8edd1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:26.796781 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d4be5e5-9357-4555-84a7-940ce0c8edd1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:26.797473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d4be5e5-9357-4555-84a7-940ce0c8edd1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:26.797926 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d4be5e5-9357-4555-84a7-940ce0c8edd1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:26.798351 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d4be5e5-9357-4555-84a7-940ce0c8edd1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:26.946334 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4d4be5e5-9357-4555-84a7-940ce0c8edd1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:26.954385 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4d4be5e5-9357-4555-84a7-940ce0c8edd1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.169167 Aug 30 01:17:26.954972 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 66/127] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:26 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:27.978906 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cf2f9b8a-b6b3-49df-bbd6-6204d9c152cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:27.979576 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cf2f9b8a-b6b3-49df-bbd6-6204d9c152cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:27.990676 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cf2f9b8a-b6b3-49df-bbd6-6204d9c152cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:27.991712 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cf2f9b8a-b6b3-49df-bbd6-6204d9c152cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:27.992450 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cf2f9b8a-b6b3-49df-bbd6-6204d9c152cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:27.993698 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cf2f9b8a-b6b3-49df-bbd6-6204d9c152cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:27.994423 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cf2f9b8a-b6b3-49df-bbd6-6204d9c152cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:27.995695 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cf2f9b8a-b6b3-49df-bbd6-6204d9c152cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:28.143524 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-cf2f9b8a-b6b3-49df-bbd6-6204d9c152cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:28.152602 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cf2f9b8a-b6b3-49df-bbd6-6204d9c152cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.179915 Aug 30 01:17:28.153285 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 67/128] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:27 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:29.178066 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bfc16b3a-66be-43ff-8373-bc9e47f4b4da tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:29.179669 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bfc16b3a-66be-43ff-8373-bc9e47f4b4da tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:29.184940 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfc16b3a-66be-43ff-8373-bc9e47f4b4da tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:29.185431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfc16b3a-66be-43ff-8373-bc9e47f4b4da tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:29.186043 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfc16b3a-66be-43ff-8373-bc9e47f4b4da tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:29.186554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfc16b3a-66be-43ff-8373-bc9e47f4b4da tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:29.186989 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfc16b3a-66be-43ff-8373-bc9e47f4b4da tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:29.187411 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfc16b3a-66be-43ff-8373-bc9e47f4b4da tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:29.322245 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bfc16b3a-66be-43ff-8373-bc9e47f4b4da tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:29.329959 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bfc16b3a-66be-43ff-8373-bc9e47f4b4da tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.155843 Aug 30 01:17:29.330528 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 68/129] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:29 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:30.351546 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b324412f-4884-45fa-88e7-7540766cdecd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:30.352201 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b324412f-4884-45fa-88e7-7540766cdecd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:30.358420 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b324412f-4884-45fa-88e7-7540766cdecd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:30.358905 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b324412f-4884-45fa-88e7-7540766cdecd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:30.359340 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b324412f-4884-45fa-88e7-7540766cdecd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:30.360076 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b324412f-4884-45fa-88e7-7540766cdecd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:30.360532 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b324412f-4884-45fa-88e7-7540766cdecd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:30.360945 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b324412f-4884-45fa-88e7-7540766cdecd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:30.502210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b324412f-4884-45fa-88e7-7540766cdecd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:30.510264 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b324412f-4884-45fa-88e7-7540766cdecd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.163226 Aug 30 01:17:30.510845 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 69/130] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:30 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:31.216456 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=37 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:31.510868 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9948a1ed-f78b-4f8f-b6dd-efbd7c73dcaf tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "POST /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.305709 Aug 30 01:17:31.511785 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 62/131] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:17:21 2022] POST /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf/os-volume_attachments => generated 194 bytes in 10308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:31.535684 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b8e4c60e-f3d1-4d09-a1d2-fde03543e9d8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:31.536754 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b8e4c60e-f3d1-4d09-a1d2-fde03543e9d8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:31.541091 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=74 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:31.546718 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8e4c60e-f3d1-4d09-a1d2-fde03543e9d8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:31.547448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8e4c60e-f3d1-4d09-a1d2-fde03543e9d8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:31.547882 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8e4c60e-f3d1-4d09-a1d2-fde03543e9d8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:31.548778 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8e4c60e-f3d1-4d09-a1d2-fde03543e9d8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:31.549229 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8e4c60e-f3d1-4d09-a1d2-fde03543e9d8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:31.550383 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8e4c60e-f3d1-4d09-a1d2-fde03543e9d8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:31.718339 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b8e4c60e-f3d1-4d09-a1d2-fde03543e9d8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:31.726160 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b8e4c60e-f3d1-4d09-a1d2-fde03543e9d8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.194631 Aug 30 01:17:31.726721 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 70/132] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:31 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:32.751247 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8d029dbc-fcc2-4dce-89a7-3b0f9995897d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:32.752332 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8d029dbc-fcc2-4dce-89a7-3b0f9995897d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:32.762018 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d029dbc-fcc2-4dce-89a7-3b0f9995897d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:32.762804 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d029dbc-fcc2-4dce-89a7-3b0f9995897d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:32.763303 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d029dbc-fcc2-4dce-89a7-3b0f9995897d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:32.764532 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d029dbc-fcc2-4dce-89a7-3b0f9995897d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:32.764983 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d029dbc-fcc2-4dce-89a7-3b0f9995897d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:32.765826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d029dbc-fcc2-4dce-89a7-3b0f9995897d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:33.093969 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d029dbc-fcc2-4dce-89a7-3b0f9995897d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:33.102368 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8d029dbc-fcc2-4dce-89a7-3b0f9995897d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.357749 Aug 30 01:17:33.103354 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 63/133] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:32 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:34.123567 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6eac9c8a-9b81-4242-a1e5-6c296f0cba5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:34.124214 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6eac9c8a-9b81-4242-a1e5-6c296f0cba5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:34.130674 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6eac9c8a-9b81-4242-a1e5-6c296f0cba5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:34.131156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6eac9c8a-9b81-4242-a1e5-6c296f0cba5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:34.131585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6eac9c8a-9b81-4242-a1e5-6c296f0cba5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:34.132311 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6eac9c8a-9b81-4242-a1e5-6c296f0cba5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:34.132764 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6eac9c8a-9b81-4242-a1e5-6c296f0cba5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:34.133187 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6eac9c8a-9b81-4242-a1e5-6c296f0cba5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:34.275504 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6eac9c8a-9b81-4242-a1e5-6c296f0cba5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:34.286659 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6eac9c8a-9b81-4242-a1e5-6c296f0cba5d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.166989 Aug 30 01:17:34.287307 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 71/134] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:34 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:35.309598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-eae20dad-6710-40d0-b4aa-70fa1ba676b5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:35.310205 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-eae20dad-6710-40d0-b4aa-70fa1ba676b5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:35.316887 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eae20dad-6710-40d0-b4aa-70fa1ba676b5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:35.317492 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eae20dad-6710-40d0-b4aa-70fa1ba676b5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:35.317766 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eae20dad-6710-40d0-b4aa-70fa1ba676b5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:35.318458 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eae20dad-6710-40d0-b4aa-70fa1ba676b5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:35.318904 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eae20dad-6710-40d0-b4aa-70fa1ba676b5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:35.319324 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eae20dad-6710-40d0-b4aa-70fa1ba676b5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:35.456063 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-eae20dad-6710-40d0-b4aa-70fa1ba676b5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:35.464251 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-eae20dad-6710-40d0-b4aa-70fa1ba676b5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.158400 Aug 30 01:17:35.464860 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 64/135] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:35 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:36.493892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-aac2dfdf-bbf5-4173-9946-7a394dbd61fe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:36.495858 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-aac2dfdf-bbf5-4173-9946-7a394dbd61fe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:36.510486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aac2dfdf-bbf5-4173-9946-7a394dbd61fe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:36.511741 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aac2dfdf-bbf5-4173-9946-7a394dbd61fe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:36.513198 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aac2dfdf-bbf5-4173-9946-7a394dbd61fe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:36.515156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aac2dfdf-bbf5-4173-9946-7a394dbd61fe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:36.516470 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aac2dfdf-bbf5-4173-9946-7a394dbd61fe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:36.517512 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aac2dfdf-bbf5-4173-9946-7a394dbd61fe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:36.807723 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-aac2dfdf-bbf5-4173-9946-7a394dbd61fe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:36.817928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-aac2dfdf-bbf5-4173-9946-7a394dbd61fe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.334161 Aug 30 01:17:36.818257 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 72/136] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:36 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:37.842735 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cf361a47-a2db-4efa-aee0-5a24d2cc2c94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:37.843323 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cf361a47-a2db-4efa-aee0-5a24d2cc2c94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:37.851077 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cf361a47-a2db-4efa-aee0-5a24d2cc2c94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:37.851572 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cf361a47-a2db-4efa-aee0-5a24d2cc2c94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:37.852478 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cf361a47-a2db-4efa-aee0-5a24d2cc2c94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:37.852717 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cf361a47-a2db-4efa-aee0-5a24d2cc2c94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:37.853164 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cf361a47-a2db-4efa-aee0-5a24d2cc2c94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:37.853586 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cf361a47-a2db-4efa-aee0-5a24d2cc2c94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:37.999734 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cf361a47-a2db-4efa-aee0-5a24d2cc2c94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:38.009029 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cf361a47-a2db-4efa-aee0-5a24d2cc2c94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.169951 Aug 30 01:17:38.009676 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 65/137] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:37 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:39.030601 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-40b86b54-d543-439c-8674-15e9743050b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:39.031176 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-40b86b54-d543-439c-8674-15e9743050b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:39.037975 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-40b86b54-d543-439c-8674-15e9743050b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:39.038462 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-40b86b54-d543-439c-8674-15e9743050b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:39.038899 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-40b86b54-d543-439c-8674-15e9743050b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:39.039594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-40b86b54-d543-439c-8674-15e9743050b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:39.040072 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-40b86b54-d543-439c-8674-15e9743050b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:39.040501 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-40b86b54-d543-439c-8674-15e9743050b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:39.177026 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-40b86b54-d543-439c-8674-15e9743050b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:39.185259 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-40b86b54-d543-439c-8674-15e9743050b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.158468 Aug 30 01:17:39.186043 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 73/138] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:39 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:40.207489 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5b88b088-53a7-4bb3-b4d7-57bc55148914 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:40.208183 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5b88b088-53a7-4bb3-b4d7-57bc55148914 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:40.216265 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b88b088-53a7-4bb3-b4d7-57bc55148914 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:40.216741 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b88b088-53a7-4bb3-b4d7-57bc55148914 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:40.217167 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b88b088-53a7-4bb3-b4d7-57bc55148914 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:40.218275 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b88b088-53a7-4bb3-b4d7-57bc55148914 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:40.218275 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b88b088-53a7-4bb3-b4d7-57bc55148914 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:40.218688 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b88b088-53a7-4bb3-b4d7-57bc55148914 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:40.357663 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5b88b088-53a7-4bb3-b4d7-57bc55148914 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:40.366042 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5b88b088-53a7-4bb3-b4d7-57bc55148914 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.162888 Aug 30 01:17:40.366621 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 66/139] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:40 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:41.387870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fb143202-a8a8-4fdb-8684-b08cce3727dd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:41.388932 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fb143202-a8a8-4fdb-8684-b08cce3727dd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:41.397257 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb143202-a8a8-4fdb-8684-b08cce3727dd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:41.397897 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb143202-a8a8-4fdb-8684-b08cce3727dd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:41.398529 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb143202-a8a8-4fdb-8684-b08cce3727dd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:41.399590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb143202-a8a8-4fdb-8684-b08cce3727dd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:41.400099 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb143202-a8a8-4fdb-8684-b08cce3727dd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:41.400512 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb143202-a8a8-4fdb-8684-b08cce3727dd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:41.419382 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:41.549910 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fb143202-a8a8-4fdb-8684-b08cce3727dd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:41.558611 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fb143202-a8a8-4fdb-8684-b08cce3727dd tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.175280 Aug 30 01:17:41.560032 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 74/140] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:41 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:42.579919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ad9e1167-4927-4950-9f5d-63facf90de7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:42.580610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ad9e1167-4927-4950-9f5d-63facf90de7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:42.588471 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad9e1167-4927-4950-9f5d-63facf90de7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:42.588951 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad9e1167-4927-4950-9f5d-63facf90de7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:42.589382 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad9e1167-4927-4950-9f5d-63facf90de7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:42.590144 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad9e1167-4927-4950-9f5d-63facf90de7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:42.590586 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad9e1167-4927-4950-9f5d-63facf90de7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:42.591003 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad9e1167-4927-4950-9f5d-63facf90de7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:42.741872 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ad9e1167-4927-4950-9f5d-63facf90de7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:42.750994 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ad9e1167-4927-4950-9f5d-63facf90de7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.174812 Aug 30 01:17:42.751570 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 67/141] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:42 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:43.776344 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d9022a24-80f4-4d2d-b6ba-b282b4930ad7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:43.776960 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d9022a24-80f4-4d2d-b6ba-b282b4930ad7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:43.786400 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9022a24-80f4-4d2d-b6ba-b282b4930ad7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:43.787715 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9022a24-80f4-4d2d-b6ba-b282b4930ad7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:43.788208 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9022a24-80f4-4d2d-b6ba-b282b4930ad7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:43.788971 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9022a24-80f4-4d2d-b6ba-b282b4930ad7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:43.789433 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9022a24-80f4-4d2d-b6ba-b282b4930ad7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:43.789853 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9022a24-80f4-4d2d-b6ba-b282b4930ad7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:43.959804 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d9022a24-80f4-4d2d-b6ba-b282b4930ad7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:43.976816 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d9022a24-80f4-4d2d-b6ba-b282b4930ad7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.206558 Aug 30 01:17:43.978576 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 75/142] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:43 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:45.003924 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-15aba424-260e-4e41-b69a-5108e851ab22 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:45.004590 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-15aba424-260e-4e41-b69a-5108e851ab22 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:45.012666 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15aba424-260e-4e41-b69a-5108e851ab22 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:45.013478 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15aba424-260e-4e41-b69a-5108e851ab22 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:45.014102 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15aba424-260e-4e41-b69a-5108e851ab22 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:45.015342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15aba424-260e-4e41-b69a-5108e851ab22 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:45.015951 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15aba424-260e-4e41-b69a-5108e851ab22 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:45.016933 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15aba424-260e-4e41-b69a-5108e851ab22 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:45.217214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-15aba424-260e-4e41-b69a-5108e851ab22 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:45.227047 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-15aba424-260e-4e41-b69a-5108e851ab22 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.227309 Aug 30 01:17:45.227933 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 68/143] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:44 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:46.249450 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-680ff0a7-a25d-47a0-9ad6-954333242f94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:46.250268 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-680ff0a7-a25d-47a0-9ad6-954333242f94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:46.258091 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-680ff0a7-a25d-47a0-9ad6-954333242f94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:46.258986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-680ff0a7-a25d-47a0-9ad6-954333242f94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:46.259705 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-680ff0a7-a25d-47a0-9ad6-954333242f94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:46.261091 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-680ff0a7-a25d-47a0-9ad6-954333242f94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:46.261729 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-680ff0a7-a25d-47a0-9ad6-954333242f94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:46.262342 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-680ff0a7-a25d-47a0-9ad6-954333242f94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:46.414285 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-680ff0a7-a25d-47a0-9ad6-954333242f94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:46.421600 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-680ff0a7-a25d-47a0-9ad6-954333242f94 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.176132 Aug 30 01:17:46.422175 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 76/144] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:46 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:47.014510 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1937577676", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:47.076903 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] validate_networks() for None {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:17:47.434919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:17:47.436451 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:17:47.439091 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:17:47.440070 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:17:47.442978 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:17:47.457787 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b90283fe-8ba1-491e-b385-3f67d3f83c44 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:47.460409 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b90283fe-8ba1-491e-b385-3f67d3f83c44 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:47.465007 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:47.466084 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:47.467008 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:47.468546 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:47.469914 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:47.470830 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:47.475975 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b90283fe-8ba1-491e-b385-3f67d3f83c44 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:47.476961 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b90283fe-8ba1-491e-b385-3f67d3f83c44 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:47.477810 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b90283fe-8ba1-491e-b385-3f67d3f83c44 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:47.479171 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b90283fe-8ba1-491e-b385-3f67d3f83c44 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:47.480490 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b90283fe-8ba1-491e-b385-3f67d3f83c44 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:47.483404 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b90283fe-8ba1-491e-b385-3f67d3f83c44 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:47.523576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Getting quotas for project 585255dc2f0344dbbad821bf1110cda5. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:17:47.534712 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Getting quotas for user 1d34f688d0b94401a1907e9845a61fc5 and project 585255dc2f0344dbbad821bf1110cda5. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:17:47.568398 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:17:47.571465 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:17:47.625739 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-48ed4cfb-7a0b-4bf0-8ffb-0ffdc7e04df6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615617 Aug 30 01:17:47.626729 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 69/145] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:17:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:17:47.639862 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4890570a-f45e-4af7-b031-bfe301a0afe7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:47.640712 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4890570a-f45e-4af7-b031-bfe301a0afe7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:47.722376 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4890570a-f45e-4af7-b031-bfe301a0afe7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:47.740848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4890570a-f45e-4af7-b031-bfe301a0afe7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1215 microversion: 2.1 time: 0.105838 Aug 30 01:17:47.741429 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 70/146] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:47 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:47.795442 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b90283fe-8ba1-491e-b385-3f67d3f83c44 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:47.808775 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b90283fe-8ba1-491e-b385-3f67d3f83c44 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.365566 Aug 30 01:17:47.809651 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 77/147] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:47 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:48.764635 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bf1d7667-1b3e-4cc4-93e1-5ea9836463a8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:48.766419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bf1d7667-1b3e-4cc4-93e1-5ea9836463a8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:48.778595 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf1d7667-1b3e-4cc4-93e1-5ea9836463a8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:48.779522 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf1d7667-1b3e-4cc4-93e1-5ea9836463a8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:48.780328 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf1d7667-1b3e-4cc4-93e1-5ea9836463a8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:48.782328 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf1d7667-1b3e-4cc4-93e1-5ea9836463a8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:48.782881 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf1d7667-1b3e-4cc4-93e1-5ea9836463a8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:48.783647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf1d7667-1b3e-4cc4-93e1-5ea9836463a8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:48.821293 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:48.834831 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-06616d17-b241-4f80-a39b-5f1818d4917c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:48.835847 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-06616d17-b241-4f80-a39b-5f1818d4917c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:48.856497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06616d17-b241-4f80-a39b-5f1818d4917c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:48.858779 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06616d17-b241-4f80-a39b-5f1818d4917c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:48.860809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06616d17-b241-4f80-a39b-5f1818d4917c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:48.866169 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06616d17-b241-4f80-a39b-5f1818d4917c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:48.866982 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06616d17-b241-4f80-a39b-5f1818d4917c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:48.867738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06616d17-b241-4f80-a39b-5f1818d4917c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:48.910936 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bf1d7667-1b3e-4cc4-93e1-5ea9836463a8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:48.924779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bf1d7667-1b3e-4cc4-93e1-5ea9836463a8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1219 microversion: 2.1 time: 0.165527 Aug 30 01:17:48.926419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 71/148] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:48 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:49.104630 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-06616d17-b241-4f80-a39b-5f1818d4917c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:49.113348 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-06616d17-b241-4f80-a39b-5f1818d4917c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.285519 Aug 30 01:17:49.113945 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 78/149] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:48 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:49.947523 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-51f83e0a-5a38-4585-88c6-8f6837427f99 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:49.948170 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-51f83e0a-5a38-4585-88c6-8f6837427f99 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:49.955418 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51f83e0a-5a38-4585-88c6-8f6837427f99 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:49.956529 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51f83e0a-5a38-4585-88c6-8f6837427f99 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:49.956759 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51f83e0a-5a38-4585-88c6-8f6837427f99 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:49.957464 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51f83e0a-5a38-4585-88c6-8f6837427f99 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:49.957888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51f83e0a-5a38-4585-88c6-8f6837427f99 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:49.958311 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51f83e0a-5a38-4585-88c6-8f6837427f99 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:50.030157 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-51f83e0a-5a38-4585-88c6-8f6837427f99 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:50.040253 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-51f83e0a-5a38-4585-88c6-8f6837427f99 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1219 microversion: 2.1 time: 0.096739 Aug 30 01:17:50.041059 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 72/150] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:49 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:50.133935 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ff41f56a-279a-4ba8-95c8-dd43b06369a2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:50.134532 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ff41f56a-279a-4ba8-95c8-dd43b06369a2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:50.141083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff41f56a-279a-4ba8-95c8-dd43b06369a2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:50.141360 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff41f56a-279a-4ba8-95c8-dd43b06369a2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:50.141804 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff41f56a-279a-4ba8-95c8-dd43b06369a2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:50.142483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff41f56a-279a-4ba8-95c8-dd43b06369a2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:50.142926 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff41f56a-279a-4ba8-95c8-dd43b06369a2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:50.144125 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff41f56a-279a-4ba8-95c8-dd43b06369a2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:50.281029 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ff41f56a-279a-4ba8-95c8-dd43b06369a2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:50.289896 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ff41f56a-279a-4ba8-95c8-dd43b06369a2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.159696 Aug 30 01:17:50.290724 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 79/151] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:50 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:51.061263 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3d911f91-934e-42e6-8347-4a2b5263bd7c tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:51.061921 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3d911f91-934e-42e6-8347-4a2b5263bd7c tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:51.069416 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d911f91-934e-42e6-8347-4a2b5263bd7c tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:51.069900 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d911f91-934e-42e6-8347-4a2b5263bd7c tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:51.070329 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d911f91-934e-42e6-8347-4a2b5263bd7c tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:51.071022 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d911f91-934e-42e6-8347-4a2b5263bd7c tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:51.071496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d911f91-934e-42e6-8347-4a2b5263bd7c tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:51.071916 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d911f91-934e-42e6-8347-4a2b5263bd7c tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:51.134854 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3d911f91-934e-42e6-8347-4a2b5263bd7c tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:51.142734 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3d911f91-934e-42e6-8347-4a2b5263bd7c tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1211 microversion: 2.1 time: 0.085355 Aug 30 01:17:51.143878 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 73/152] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:51 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:51.313298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-18f93a73-f931-4368-ac1f-e6289ba4b17c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:51.313834 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-18f93a73-f931-4368-ac1f-e6289ba4b17c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:51.320634 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-18f93a73-f931-4368-ac1f-e6289ba4b17c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:51.321117 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-18f93a73-f931-4368-ac1f-e6289ba4b17c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:51.321543 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-18f93a73-f931-4368-ac1f-e6289ba4b17c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:51.322256 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-18f93a73-f931-4368-ac1f-e6289ba4b17c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:51.322697 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-18f93a73-f931-4368-ac1f-e6289ba4b17c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:51.323112 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-18f93a73-f931-4368-ac1f-e6289ba4b17c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:51.467400 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-18f93a73-f931-4368-ac1f-e6289ba4b17c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:51.476106 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-18f93a73-f931-4368-ac1f-e6289ba4b17c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.166548 Aug 30 01:17:51.476776 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 80/153] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:51 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:52.164608 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-62eb4905-287d-45c8-8f0b-0be5fec8a18e tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:52.165307 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-62eb4905-287d-45c8-8f0b-0be5fec8a18e tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:52.172795 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62eb4905-287d-45c8-8f0b-0be5fec8a18e tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:52.173430 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62eb4905-287d-45c8-8f0b-0be5fec8a18e tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:52.179874 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62eb4905-287d-45c8-8f0b-0be5fec8a18e tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:52.179874 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62eb4905-287d-45c8-8f0b-0be5fec8a18e tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:52.179874 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62eb4905-287d-45c8-8f0b-0be5fec8a18e tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:52.179874 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62eb4905-287d-45c8-8f0b-0be5fec8a18e tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:52.243968 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-62eb4905-287d-45c8-8f0b-0be5fec8a18e tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:52.251848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-62eb4905-287d-45c8-8f0b-0be5fec8a18e tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1267 microversion: 2.1 time: 0.091451 Aug 30 01:17:52.253117 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 74/154] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:52 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:52.500566 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ebfaa627-aedf-434b-8afc-80e32ee5255e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:52.501177 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ebfaa627-aedf-434b-8afc-80e32ee5255e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:52.515044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebfaa627-aedf-434b-8afc-80e32ee5255e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:52.515772 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebfaa627-aedf-434b-8afc-80e32ee5255e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:52.516569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebfaa627-aedf-434b-8afc-80e32ee5255e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:52.517559 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebfaa627-aedf-434b-8afc-80e32ee5255e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:52.518734 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebfaa627-aedf-434b-8afc-80e32ee5255e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:52.519394 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebfaa627-aedf-434b-8afc-80e32ee5255e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:52.708572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ebfaa627-aedf-434b-8afc-80e32ee5255e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:52.730452 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ebfaa627-aedf-434b-8afc-80e32ee5255e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.233553 Aug 30 01:17:52.731286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 81/155] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:52 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:53.180988 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0375a127-3b90-4b14-aade-8885fd778c88 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:53.181427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0375a127-3b90-4b14-aade-8885fd778c88 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:53.189451 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0375a127-3b90-4b14-aade-8885fd778c88 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.190907 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0375a127-3b90-4b14-aade-8885fd778c88 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.192218 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0375a127-3b90-4b14-aade-8885fd778c88 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.193283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0375a127-3b90-4b14-aade-8885fd778c88 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.193738 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0375a127-3b90-4b14-aade-8885fd778c88 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.194814 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0375a127-3b90-4b14-aade-8885fd778c88 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.238516 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0375a127-3b90-4b14-aade-8885fd778c88 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:17:53.289272 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9bc8433d-c82b-4c67-8d43-2d993e0b6c55 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:53.289272 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9bc8433d-c82b-4c67-8d43-2d993e0b6c55 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:53.302317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9bc8433d-c82b-4c67-8d43-2d993e0b6c55 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.303608 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9bc8433d-c82b-4c67-8d43-2d993e0b6c55 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.304600 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9bc8433d-c82b-4c67-8d43-2d993e0b6c55 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.307262 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9bc8433d-c82b-4c67-8d43-2d993e0b6c55 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.316642 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9bc8433d-c82b-4c67-8d43-2d993e0b6c55 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.317158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9bc8433d-c82b-4c67-8d43-2d993e0b6c55 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.406765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9bc8433d-c82b-4c67-8d43-2d993e0b6c55 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:53.421929 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9bc8433d-c82b-4c67-8d43-2d993e0b6c55 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1273 microversion: 2.1 time: 0.150325 Aug 30 01:17:53.423281 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 82/156] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:53 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:53.433460 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0375a127-3b90-4b14-aade-8885fd778c88 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 204 len: 0 microversion: 2.1 time: 0.256444 Aug 30 01:17:53.434708 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 75/157] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:17:53 2022] DELETE /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:17:53.445361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c2db7202-7a7c-4c85-a856-fd85ed87cb3c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:53.445970 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c2db7202-7a7c-4c85-a856-fd85ed87cb3c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:53.455112 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2db7202-7a7c-4c85-a856-fd85ed87cb3c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.456129 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2db7202-7a7c-4c85-a856-fd85ed87cb3c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.456740 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2db7202-7a7c-4c85-a856-fd85ed87cb3c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.458879 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2db7202-7a7c-4c85-a856-fd85ed87cb3c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.459795 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2db7202-7a7c-4c85-a856-fd85ed87cb3c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.460249 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2db7202-7a7c-4c85-a856-fd85ed87cb3c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.690634 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c2db7202-7a7c-4c85-a856-fd85ed87cb3c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:53.700196 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c2db7202-7a7c-4c85-a856-fd85ed87cb3c tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1553 microversion: 2.1 time: 0.258505 Aug 30 01:17:53.701554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 83/158] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:53 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1553 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:53.754294 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8365c54e-45f5-4025-a959-5df4efeb825a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:53.754993 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8365c54e-45f5-4025-a959-5df4efeb825a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:53.762757 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8365c54e-45f5-4025-a959-5df4efeb825a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.763238 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8365c54e-45f5-4025-a959-5df4efeb825a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.763676 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8365c54e-45f5-4025-a959-5df4efeb825a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.764564 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8365c54e-45f5-4025-a959-5df4efeb825a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.765006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8365c54e-45f5-4025-a959-5df4efeb825a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.766937 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8365c54e-45f5-4025-a959-5df4efeb825a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.912762 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8365c54e-45f5-4025-a959-5df4efeb825a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:53.921616 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8365c54e-45f5-4025-a959-5df4efeb825a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.173409 Aug 30 01:17:53.922201 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 76/159] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:53 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:54.446147 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1f63ab53-7fdf-4634-8604-c794ade79d05 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:54.446689 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1f63ab53-7fdf-4634-8604-c794ade79d05 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:54.452998 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1f63ab53-7fdf-4634-8604-c794ade79d05 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:54.453493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1f63ab53-7fdf-4634-8604-c794ade79d05 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:54.453929 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1f63ab53-7fdf-4634-8604-c794ade79d05 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:54.454964 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1f63ab53-7fdf-4634-8604-c794ade79d05 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:54.455104 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1f63ab53-7fdf-4634-8604-c794ade79d05 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:54.456022 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1f63ab53-7fdf-4634-8604-c794ade79d05 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:54.605689 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1f63ab53-7fdf-4634-8604-c794ade79d05 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:54.615069 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1f63ab53-7fdf-4634-8604-c794ade79d05 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1315 microversion: 2.1 time: 0.172332 Aug 30 01:17:54.616032 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 84/160] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:54 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:54.721359 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ec340fdb-f331-4f62-9d43-5909f0f78f8e tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:54.722071 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ec340fdb-f331-4f62-9d43-5909f0f78f8e tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:54.728491 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ec340fdb-f331-4f62-9d43-5909f0f78f8e tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:54.728997 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ec340fdb-f331-4f62-9d43-5909f0f78f8e tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:54.729422 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ec340fdb-f331-4f62-9d43-5909f0f78f8e tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:54.730098 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ec340fdb-f331-4f62-9d43-5909f0f78f8e tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:54.730613 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ec340fdb-f331-4f62-9d43-5909f0f78f8e tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:54.731026 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ec340fdb-f331-4f62-9d43-5909f0f78f8e tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:54.865166 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ec340fdb-f331-4f62-9d43-5909f0f78f8e tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:54.873653 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ec340fdb-f331-4f62-9d43-5909f0f78f8e tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1553 microversion: 2.1 time: 0.156199 Aug 30 01:17:54.874238 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 77/161] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:54 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:54.943616 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-91c0e86d-f1d6-4c4d-b262-19b230f1f86f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:54.944273 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-91c0e86d-f1d6-4c4d-b262-19b230f1f86f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:54.950405 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91c0e86d-f1d6-4c4d-b262-19b230f1f86f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:54.950884 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91c0e86d-f1d6-4c4d-b262-19b230f1f86f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:54.951316 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91c0e86d-f1d6-4c4d-b262-19b230f1f86f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:54.952014 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91c0e86d-f1d6-4c4d-b262-19b230f1f86f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:54.952475 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91c0e86d-f1d6-4c4d-b262-19b230f1f86f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:54.952902 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91c0e86d-f1d6-4c4d-b262-19b230f1f86f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:55.084621 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-91c0e86d-f1d6-4c4d-b262-19b230f1f86f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:55.092369 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-91c0e86d-f1d6-4c4d-b262-19b230f1f86f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.153102 Aug 30 01:17:55.092948 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 85/162] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:54 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:55.636843 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6d3ff23f-bfc2-47b6-9c53-c3fb16aff455 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:55.637714 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6d3ff23f-bfc2-47b6-9c53-c3fb16aff455 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:55.644118 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d3ff23f-bfc2-47b6-9c53-c3fb16aff455 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:55.644606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d3ff23f-bfc2-47b6-9c53-c3fb16aff455 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:55.645046 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d3ff23f-bfc2-47b6-9c53-c3fb16aff455 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:55.645748 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d3ff23f-bfc2-47b6-9c53-c3fb16aff455 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:55.646195 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d3ff23f-bfc2-47b6-9c53-c3fb16aff455 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:55.646715 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d3ff23f-bfc2-47b6-9c53-c3fb16aff455 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:55.779651 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6d3ff23f-bfc2-47b6-9c53-c3fb16aff455 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:55.788365 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6d3ff23f-bfc2-47b6-9c53-c3fb16aff455 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1315 microversion: 2.1 time: 0.155268 Aug 30 01:17:55.788861 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 78/163] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:55 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:55.897052 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e487968f-13a2-446a-bbb9-75b9c6b536fc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:55.897662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e487968f-13a2-446a-bbb9-75b9c6b536fc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:55.903840 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e487968f-13a2-446a-bbb9-75b9c6b536fc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:55.904386 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e487968f-13a2-446a-bbb9-75b9c6b536fc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:55.904887 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e487968f-13a2-446a-bbb9-75b9c6b536fc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:55.905594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e487968f-13a2-446a-bbb9-75b9c6b536fc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:55.906043 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e487968f-13a2-446a-bbb9-75b9c6b536fc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:55.906475 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e487968f-13a2-446a-bbb9-75b9c6b536fc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:56.045169 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e487968f-13a2-446a-bbb9-75b9c6b536fc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:56.053898 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e487968f-13a2-446a-bbb9-75b9c6b536fc tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1553 microversion: 2.1 time: 0.161091 Aug 30 01:17:56.054687 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 86/164] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:55 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:56.114683 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d46686f4-f4b2-450a-ab10-9e78ba919fb3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:56.115352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d46686f4-f4b2-450a-ab10-9e78ba919fb3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:56.121789 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d46686f4-f4b2-450a-ab10-9e78ba919fb3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:56.122371 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d46686f4-f4b2-450a-ab10-9e78ba919fb3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:56.122854 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d46686f4-f4b2-450a-ab10-9e78ba919fb3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:56.123821 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d46686f4-f4b2-450a-ab10-9e78ba919fb3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:56.124340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d46686f4-f4b2-450a-ab10-9e78ba919fb3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:56.125034 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d46686f4-f4b2-450a-ab10-9e78ba919fb3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:56.268909 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d46686f4-f4b2-450a-ab10-9e78ba919fb3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:56.276789 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d46686f4-f4b2-450a-ab10-9e78ba919fb3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.167057 Aug 30 01:17:56.277360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 79/165] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:56 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:56.810595 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f3b6786a-02ca-4180-b9f2-ead0fd0db73b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:56.811204 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f3b6786a-02ca-4180-b9f2-ead0fd0db73b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:56.817427 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f3b6786a-02ca-4180-b9f2-ead0fd0db73b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:56.817909 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f3b6786a-02ca-4180-b9f2-ead0fd0db73b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:56.818348 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f3b6786a-02ca-4180-b9f2-ead0fd0db73b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:56.819031 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f3b6786a-02ca-4180-b9f2-ead0fd0db73b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:56.819482 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f3b6786a-02ca-4180-b9f2-ead0fd0db73b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:56.819905 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f3b6786a-02ca-4180-b9f2-ead0fd0db73b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:56.958749 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f3b6786a-02ca-4180-b9f2-ead0fd0db73b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:56.966793 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f3b6786a-02ca-4180-b9f2-ead0fd0db73b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1315 microversion: 2.1 time: 0.160108 Aug 30 01:17:56.967374 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 87/166] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:56 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:57.075755 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3dbf280a-6a2c-4f50-856e-ed2623289d8f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:57.076396 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3dbf280a-6a2c-4f50-856e-ed2623289d8f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:57.084291 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3dbf280a-6a2c-4f50-856e-ed2623289d8f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:57.084790 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3dbf280a-6a2c-4f50-856e-ed2623289d8f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:57.085232 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3dbf280a-6a2c-4f50-856e-ed2623289d8f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:57.085944 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3dbf280a-6a2c-4f50-856e-ed2623289d8f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:57.086394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3dbf280a-6a2c-4f50-856e-ed2623289d8f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:57.086819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3dbf280a-6a2c-4f50-856e-ed2623289d8f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:57.242797 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3dbf280a-6a2c-4f50-856e-ed2623289d8f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:57.252900 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3dbf280a-6a2c-4f50-856e-ed2623289d8f tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1553 microversion: 2.1 time: 0.180485 Aug 30 01:17:57.253547 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 80/167] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:57 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1553 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:57.299617 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d865854f-8ea5-41b4-a514-20ddd5842862 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:57.300304 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d865854f-8ea5-41b4-a514-20ddd5842862 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:57.307087 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d865854f-8ea5-41b4-a514-20ddd5842862 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:57.307631 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d865854f-8ea5-41b4-a514-20ddd5842862 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:57.308115 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d865854f-8ea5-41b4-a514-20ddd5842862 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:57.308823 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d865854f-8ea5-41b4-a514-20ddd5842862 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:57.309275 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d865854f-8ea5-41b4-a514-20ddd5842862 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:57.309730 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d865854f-8ea5-41b4-a514-20ddd5842862 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:57.474793 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d865854f-8ea5-41b4-a514-20ddd5842862 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:57.490536 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d865854f-8ea5-41b4-a514-20ddd5842862 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.195042 Aug 30 01:17:57.491594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 88/168] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:57 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:57.988675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8a4abf67-d860-4b2b-9454-e434727c5117 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:57.990267 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8a4abf67-d860-4b2b-9454-e434727c5117 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:57.994178 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:57.995409 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=8 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:58.004998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a4abf67-d860-4b2b-9454-e434727c5117 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:58.005973 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a4abf67-d860-4b2b-9454-e434727c5117 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:58.006723 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a4abf67-d860-4b2b-9454-e434727c5117 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:58.007724 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a4abf67-d860-4b2b-9454-e434727c5117 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:58.008502 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a4abf67-d860-4b2b-9454-e434727c5117 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:58.008614 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a4abf67-d860-4b2b-9454-e434727c5117 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:58.173986 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8a4abf67-d860-4b2b-9454-e434727c5117 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:58.182402 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8a4abf67-d860-4b2b-9454-e434727c5117 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1315 microversion: 2.1 time: 0.198532 Aug 30 01:17:58.183077 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 81/169] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:57 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:58.276674 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3ca8d6ea-3484-4897-a2da-100c6965bfcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:58.277279 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3ca8d6ea-3484-4897-a2da-100c6965bfcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:58.284977 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ca8d6ea-3484-4897-a2da-100c6965bfcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:58.285467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ca8d6ea-3484-4897-a2da-100c6965bfcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:58.285904 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ca8d6ea-3484-4897-a2da-100c6965bfcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:58.286610 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ca8d6ea-3484-4897-a2da-100c6965bfcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:58.287059 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ca8d6ea-3484-4897-a2da-100c6965bfcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:58.287484 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ca8d6ea-3484-4897-a2da-100c6965bfcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:58.513213 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-99d0497b-abd1-4286-b343-dba96e52256b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:58.513851 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-99d0497b-abd1-4286-b343-dba96e52256b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:58.520580 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-99d0497b-abd1-4286-b343-dba96e52256b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:58.521135 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-99d0497b-abd1-4286-b343-dba96e52256b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:58.521662 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-99d0497b-abd1-4286-b343-dba96e52256b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:58.522414 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-99d0497b-abd1-4286-b343-dba96e52256b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:58.522932 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-99d0497b-abd1-4286-b343-dba96e52256b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:58.523347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-99d0497b-abd1-4286-b343-dba96e52256b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:58.530859 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3ca8d6ea-3484-4897-a2da-100c6965bfcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:58.547696 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3ca8d6ea-3484-4897-a2da-100c6965bfcb tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1553 microversion: 2.1 time: 0.274342 Aug 30 01:17:58.569525 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 89/170] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:58 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1553 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:58.687033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-99d0497b-abd1-4286-b343-dba96e52256b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:58.699303 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-99d0497b-abd1-4286-b343-dba96e52256b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.190223 Aug 30 01:17:58.700187 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 82/171] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:58 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:58.915878 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-96e824e2-a948-4d57-8b85-58ff501dbbfa req-2be7f9a6-bb8a-488f-b76d-737843fa6899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee5d11e5-e17e-4307-8bf7-9a00c5df8305", "tag": "6993fda7-c492-46dd-81de-aa2ee4acbfe5"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:58.928486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-96e824e2-a948-4d57-8b85-58ff501dbbfa req-2be7f9a6-bb8a-488f-b76d-737843fa6899 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:58.929309 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-96e824e2-a948-4d57-8b85-58ff501dbbfa req-2be7f9a6-bb8a-488f-b76d-737843fa6899 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:58.929635 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-96e824e2-a948-4d57-8b85-58ff501dbbfa req-2be7f9a6-bb8a-488f-b76d-737843fa6899 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:58.942818 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-96e824e2-a948-4d57-8b85-58ff501dbbfa req-2be7f9a6-bb8a-488f-b76d-737843fa6899 service nova] Creating event network-changed:6993fda7-c492-46dd-81de-aa2ee4acbfe5 for instance ee5d11e5-e17e-4307-8bf7-9a00c5df8305 on hv-cinder-81514 Aug 30 01:17:58.949521 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-96e824e2-a948-4d57-8b85-58ff501dbbfa req-2be7f9a6-bb8a-488f-b76d-737843fa6899 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039179 Aug 30 01:17:58.951092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 90/172] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:59.207444 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-017bd929-208d-4bea-8d97-7d25acf020aa tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:59.208657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-017bd929-208d-4bea-8d97-7d25acf020aa tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:59.217248 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-017bd929-208d-4bea-8d97-7d25acf020aa tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:59.217735 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-017bd929-208d-4bea-8d97-7d25acf020aa tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:59.218169 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-017bd929-208d-4bea-8d97-7d25acf020aa tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:59.218864 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-017bd929-208d-4bea-8d97-7d25acf020aa tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:59.219315 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-017bd929-208d-4bea-8d97-7d25acf020aa tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:59.219735 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-017bd929-208d-4bea-8d97-7d25acf020aa tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:59.589208 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6acfe060-8d2e-47ab-8ab4-5e20f9536e29 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:59.590555 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6acfe060-8d2e-47ab-8ab4-5e20f9536e29 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:59.608038 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6acfe060-8d2e-47ab-8ab4-5e20f9536e29 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:59.608038 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6acfe060-8d2e-47ab-8ab4-5e20f9536e29 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:59.608038 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6acfe060-8d2e-47ab-8ab4-5e20f9536e29 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:59.610393 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6acfe060-8d2e-47ab-8ab4-5e20f9536e29 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:59.612724 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6acfe060-8d2e-47ab-8ab4-5e20f9536e29 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:59.613464 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6acfe060-8d2e-47ab-8ab4-5e20f9536e29 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:59.644568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:59.748816 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-017bd929-208d-4bea-8d97-7d25acf020aa tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:59.758814 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-017bd929-208d-4bea-8d97-7d25acf020aa tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1315 microversion: 2.1 time: 0.555452 Aug 30 01:17:59.759725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 83/173] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:59 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:59.768184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4fc793e8-b302-49eb-a736-f12fc88791b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:59.772735 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4fc793e8-b302-49eb-a736-f12fc88791b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:59.779497 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4fc793e8-b302-49eb-a736-f12fc88791b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:59.779986 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4fc793e8-b302-49eb-a736-f12fc88791b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:59.780545 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4fc793e8-b302-49eb-a736-f12fc88791b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:59.781714 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4fc793e8-b302-49eb-a736-f12fc88791b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:59.782033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4fc793e8-b302-49eb-a736-f12fc88791b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:59.782470 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4fc793e8-b302-49eb-a736-f12fc88791b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:00.037677 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6acfe060-8d2e-47ab-8ab4-5e20f9536e29 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:00.059305 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6acfe060-8d2e-47ab-8ab4-5e20f9536e29 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1553 microversion: 2.1 time: 0.473899 Aug 30 01:18:00.060413 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 91/174] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:59 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1553 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:00.074799 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4fc793e8-b302-49eb-a736-f12fc88791b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:00.086647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4fc793e8-b302-49eb-a736-f12fc88791b9 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.325439 Aug 30 01:18:00.087376 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 84/175] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:59 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:00.612490 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-b0c2814f-f63b-40c1-8fc8-c9b3000a355f req-a1929eb4-e2b6-4edc-bda4-48314d4f3b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ae258e-1465-4b2c-be83-77db7a339adf", "name": "network-vif-deleted", "tag": "dc2b0901-0f5c-49be-b9ac-d776a11996b4"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:00.628541 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b0c2814f-f63b-40c1-8fc8-c9b3000a355f req-a1929eb4-e2b6-4edc-bda4-48314d4f3b77 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:00.632573 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b0c2814f-f63b-40c1-8fc8-c9b3000a355f req-a1929eb4-e2b6-4edc-bda4-48314d4f3b77 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:00.634129 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b0c2814f-f63b-40c1-8fc8-c9b3000a355f req-a1929eb4-e2b6-4edc-bda4-48314d4f3b77 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:00.649350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-b0c2814f-f63b-40c1-8fc8-c9b3000a355f req-a1929eb4-e2b6-4edc-bda4-48314d4f3b77 service nova] Creating event network-vif-deleted:dc2b0901-0f5c-49be-b9ac-d776a11996b4 for instance f3ae258e-1465-4b2c-be83-77db7a339adf on hv-cinder-81514 Aug 30 01:18:00.666694 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-b0c2814f-f63b-40c1-8fc8-c9b3000a355f req-a1929eb4-e2b6-4edc-bda4-48314d4f3b77 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061694 Aug 30 01:18:00.667492 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 92/176] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:00.780023 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bf42aac9-a3b5-4ea9-aeb4-78bf10958b87 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:00.780725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bf42aac9-a3b5-4ea9-aeb4-78bf10958b87 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:00.788089 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf42aac9-a3b5-4ea9-aeb4-78bf10958b87 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:00.801495 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf42aac9-a3b5-4ea9-aeb4-78bf10958b87 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:00.801495 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf42aac9-a3b5-4ea9-aeb4-78bf10958b87 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:00.801495 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf42aac9-a3b5-4ea9-aeb4-78bf10958b87 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:00.801495 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf42aac9-a3b5-4ea9-aeb4-78bf10958b87 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:00.802067 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf42aac9-a3b5-4ea9-aeb4-78bf10958b87 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:01.002969 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bf42aac9-a3b5-4ea9-aeb4-78bf10958b87 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:01.015564 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bf42aac9-a3b5-4ea9-aeb4-78bf10958b87 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1315 microversion: 2.1 time: 0.237777 Aug 30 01:18:01.016927 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 85/177] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:00 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:01.090253 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-30437e25-a772-4fc3-8302-2ee5db4fea19 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:01.090990 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-30437e25-a772-4fc3-8302-2ee5db4fea19 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:01.099954 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-30437e25-a772-4fc3-8302-2ee5db4fea19 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:01.100622 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-30437e25-a772-4fc3-8302-2ee5db4fea19 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:01.101330 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-30437e25-a772-4fc3-8302-2ee5db4fea19 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:01.102907 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-30437e25-a772-4fc3-8302-2ee5db4fea19 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:01.103390 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-30437e25-a772-4fc3-8302-2ee5db4fea19 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:01.103922 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-30437e25-a772-4fc3-8302-2ee5db4fea19 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:01.113608 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-27f7fca8-d31d-4593-9977-c8ce3cf459af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:01.115333 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-27f7fca8-d31d-4593-9977-c8ce3cf459af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:01.135151 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-27f7fca8-d31d-4593-9977-c8ce3cf459af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:01.135936 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-27f7fca8-d31d-4593-9977-c8ce3cf459af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:01.136583 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-27f7fca8-d31d-4593-9977-c8ce3cf459af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:01.137840 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-27f7fca8-d31d-4593-9977-c8ce3cf459af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:01.138490 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-27f7fca8-d31d-4593-9977-c8ce3cf459af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:01.138908 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-27f7fca8-d31d-4593-9977-c8ce3cf459af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:01.144245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:01.198369 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-30437e25-a772-4fc3-8302-2ee5db4fea19 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:01.209155 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-30437e25-a772-4fc3-8302-2ee5db4fea19 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1511 microversion: 2.1 time: 0.126582 Aug 30 01:18:01.210096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 93/178] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:01 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1511 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:01.375144 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-27f7fca8-d31d-4593-9977-c8ce3cf459af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:01.387605 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-27f7fca8-d31d-4593-9977-c8ce3cf459af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.281788 Aug 30 01:18:01.394485 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 86/179] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:01 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:02.045771 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-efddf617-1fde-4d84-b826-afff6643b106 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:02.046408 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-efddf617-1fde-4d84-b826-afff6643b106 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:02.049009 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=48 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:02.059502 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-efddf617-1fde-4d84-b826-afff6643b106 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:02.060247 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-efddf617-1fde-4d84-b826-afff6643b106 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:02.060835 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-efddf617-1fde-4d84-b826-afff6643b106 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:02.061740 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-efddf617-1fde-4d84-b826-afff6643b106 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:02.062682 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-efddf617-1fde-4d84-b826-afff6643b106 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:02.063295 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-efddf617-1fde-4d84-b826-afff6643b106 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:02.238022 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f52b960a-76e8-4f83-9612-32ef7dd60621 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:02.238730 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f52b960a-76e8-4f83-9612-32ef7dd60621 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:02.249770 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:02.256867 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f52b960a-76e8-4f83-9612-32ef7dd60621 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:02.262498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f52b960a-76e8-4f83-9612-32ef7dd60621 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:02.263100 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f52b960a-76e8-4f83-9612-32ef7dd60621 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:02.264043 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f52b960a-76e8-4f83-9612-32ef7dd60621 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:02.264494 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f52b960a-76e8-4f83-9612-32ef7dd60621 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:02.264971 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f52b960a-76e8-4f83-9612-32ef7dd60621 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:02.278738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-efddf617-1fde-4d84-b826-afff6643b106 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:02.293824 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-efddf617-1fde-4d84-b826-afff6643b106 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1315 microversion: 2.1 time: 0.257457 Aug 30 01:18:02.319796 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 94/180] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:02 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:02.406980 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f52b960a-76e8-4f83-9612-32ef7dd60621 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:02.418520 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bc4072f2-b322-4c80-ba13-a87bb42bd71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:02.419172 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f52b960a-76e8-4f83-9612-32ef7dd60621 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1345 microversion: 2.1 time: 0.187588 Aug 30 01:18:02.419774 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 87/181] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:02 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1345 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:02.420105 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bc4072f2-b322-4c80-ba13-a87bb42bd71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:02.429299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc4072f2-b322-4c80-ba13-a87bb42bd71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:02.430058 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc4072f2-b322-4c80-ba13-a87bb42bd71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:02.430491 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc4072f2-b322-4c80-ba13-a87bb42bd71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:02.431433 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc4072f2-b322-4c80-ba13-a87bb42bd71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:02.432326 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc4072f2-b322-4c80-ba13-a87bb42bd71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:02.433457 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc4072f2-b322-4c80-ba13-a87bb42bd71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:02.625620 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bc4072f2-b322-4c80-ba13-a87bb42bd71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:02.640523 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bc4072f2-b322-4c80-ba13-a87bb42bd71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.226700 Aug 30 01:18:02.648745 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 95/182] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:02 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:03.323930 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9d50c5f0-9139-4b70-9ac5-11c4d7738934 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:03.324678 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9d50c5f0-9139-4b70-9ac5-11c4d7738934 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:03.346894 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d50c5f0-9139-4b70-9ac5-11c4d7738934 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:03.347590 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d50c5f0-9139-4b70-9ac5-11c4d7738934 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:03.348056 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d50c5f0-9139-4b70-9ac5-11c4d7738934 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:03.354755 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d50c5f0-9139-4b70-9ac5-11c4d7738934 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:03.356073 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d50c5f0-9139-4b70-9ac5-11c4d7738934 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:03.357893 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d50c5f0-9139-4b70-9ac5-11c4d7738934 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:03.448241 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:03.449084 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:03.476981 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:03.477476 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:03.478300 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:03.479063 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:03.479530 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:03.480050 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:03.572244 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:03.574567 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:03.575299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:03.577726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lazy-loading 'fault' on Instance uuid f3ae258e-1465-4b2c-be83-77db7a339adf {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:18:03.680633 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:03.702272 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d77c2412-dcdb-4a59-9bcd-1d58daab59d3 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1350 microversion: 2.1 time: 0.259546 Aug 30 01:18:03.722505 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 96/183] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:03 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1350 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:03.735608 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a99188bb-e681-46cc-8647-baf17d55cad8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:03.739261 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a99188bb-e681-46cc-8647-baf17d55cad8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:03.753612 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a99188bb-e681-46cc-8647-baf17d55cad8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:03.755697 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a99188bb-e681-46cc-8647-baf17d55cad8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:03.758618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a99188bb-e681-46cc-8647-baf17d55cad8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:03.762517 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a99188bb-e681-46cc-8647-baf17d55cad8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:03.763263 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a99188bb-e681-46cc-8647-baf17d55cad8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:03.763979 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a99188bb-e681-46cc-8647-baf17d55cad8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:03.887006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9d50c5f0-9139-4b70-9ac5-11c4d7738934 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:03.926611 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9d50c5f0-9139-4b70-9ac5-11c4d7738934 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1315 microversion: 2.1 time: 0.607136 Aug 30 01:18:03.927663 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 88/184] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:03 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:04.105386 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a99188bb-e681-46cc-8647-baf17d55cad8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:04.126534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a99188bb-e681-46cc-8647-baf17d55cad8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.401004 Aug 30 01:18:04.129033 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 97/185] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:03 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:04.745907 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:04.746654 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:04.757725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:04.758235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:04.759753 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:04.760600 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:04.761308 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:04.762301 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:04.812757 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:04.813655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:04.815051 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:04.816107 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lazy-loading 'fault' on Instance uuid f3ae258e-1465-4b2c-be83-77db7a339adf {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:18:04.881026 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2e7c46b6aa4800834115196866b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf90b4e09e94cc984fe36b03b08a0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:04.902045 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a397567d-e1d8-46e4-a257-a2beb6c33558 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 200 len: 1350 microversion: 2.1 time: 0.160109 Aug 30 01:18:04.916030 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 89/186] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:04 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 1350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:04.957477 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ce112c7f-e25d-4b7d-bc81-64269c183602 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:04.958714 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ce112c7f-e25d-4b7d-bc81-64269c183602 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:04.972326 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ce112c7f-e25d-4b7d-bc81-64269c183602 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:04.973189 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ce112c7f-e25d-4b7d-bc81-64269c183602 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:04.974018 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ce112c7f-e25d-4b7d-bc81-64269c183602 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:04.975325 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ce112c7f-e25d-4b7d-bc81-64269c183602 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:04.976289 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ce112c7f-e25d-4b7d-bc81-64269c183602 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:04.977163 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ce112c7f-e25d-4b7d-bc81-64269c183602 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:05.178087 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4f3cf897-c05b-4a6c-8aab-4135a2257168 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:05.183968 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4f3cf897-c05b-4a6c-8aab-4135a2257168 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:05.237995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f3cf897-c05b-4a6c-8aab-4135a2257168 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:05.238927 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f3cf897-c05b-4a6c-8aab-4135a2257168 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:05.239690 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f3cf897-c05b-4a6c-8aab-4135a2257168 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:05.241061 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f3cf897-c05b-4a6c-8aab-4135a2257168 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:05.242008 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f3cf897-c05b-4a6c-8aab-4135a2257168 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:05.255305 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f3cf897-c05b-4a6c-8aab-4135a2257168 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:05.272321 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ce112c7f-e25d-4b7d-bc81-64269c183602 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:05.291375 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ce112c7f-e25d-4b7d-bc81-64269c183602 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1315 microversion: 2.1 time: 0.343392 Aug 30 01:18:05.321195 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 98/187] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:04 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:05.536579 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4f3cf897-c05b-4a6c-8aab-4135a2257168 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:05.547722 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4f3cf897-c05b-4a6c-8aab-4135a2257168 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1522 microversion: 2.1 time: 0.395803 Aug 30 01:18:05.549764 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 90/188] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:05 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:05.935366 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-be7e6f9b-8697-4718-a276-22ca673dad51 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:05.935966 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-be7e6f9b-8697-4718-a276-22ca673dad51 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:05.942578 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be7e6f9b-8697-4718-a276-22ca673dad51 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:05.944954 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be7e6f9b-8697-4718-a276-22ca673dad51 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:05.946021 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be7e6f9b-8697-4718-a276-22ca673dad51 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:05.946842 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be7e6f9b-8697-4718-a276-22ca673dad51 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:05.947297 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be7e6f9b-8697-4718-a276-22ca673dad51 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:05.947715 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be7e6f9b-8697-4718-a276-22ca673dad51 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:05.962392 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-be7e6f9b-8697-4718-a276-22ca673dad51 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] HTTP exception thrown: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-be7e6f9b-8697-4718-a276-22ca673dad51 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Request method failure captured: Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf HTTP/1.1 Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWT2WDs19oy4h3COjVtSzDynRwA0tNhnm20kGubZDxDzplM1PSY_NrPnmq5lSVqyxouh609OJu0KYzmkp9B3wj0HMsKY2ObQO8yVdTcnvPd4mGeVpmkR0P5nKOcgiBVCOFvYO7r-T-qZF3jUqjGMt4rfNuoOMq38OVohLLvvR8-Kik4 Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: 9bf90b4e09e94cc984fe36b03b08a0b6 Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-DeleteServersTestJSON-136378618 Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:18:05.974283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:18:05.976662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:18:05.976662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-DeleteServersTestJSON-136378618 Aug 30 01:18:05.976662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 9bf90b4e09e94cc984fe36b03b08a0b6 Aug 30 01:18:05.976662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-DeleteServersTestJSON-136378618 Aug 30 01:18:05.976662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-DeleteServersTestJSON-136378618-project Aug 30 01:18:05.976662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:18:05.976662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:18:05.976662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 5b2e7c46b6aa4800834115196866b244 Aug 30 01:18:05.976662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-DeleteServersTestJSON-136378618-project Aug 30 01:18:05.976662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:18:05.976662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:05.976662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': 'f3ae258e-1465-4b2c-be83-77db7a339adf'} Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:05.977837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:05.979486 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:05.982100 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-be7e6f9b-8697-4718-a276-22ca673dad51 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Returning 404 to user: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:05.982100 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-be7e6f9b-8697-4718-a276-22ca673dad51 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 404 len: 111 microversion: 2.1 time: 0.045292 Aug 30 01:18:05.982100 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 99/189] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:05 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:06.122818 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-15f90e61-c344-40e6-a9c2-7e54ef7b2655 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:06.126639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-15f90e61-c344-40e6-a9c2-7e54ef7b2655 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:06.135925 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15f90e61-c344-40e6-a9c2-7e54ef7b2655 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:06.137359 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15f90e61-c344-40e6-a9c2-7e54ef7b2655 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:06.138264 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15f90e61-c344-40e6-a9c2-7e54ef7b2655 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:06.139437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15f90e61-c344-40e6-a9c2-7e54ef7b2655 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:06.140206 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15f90e61-c344-40e6-a9c2-7e54ef7b2655 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:06.140976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15f90e61-c344-40e6-a9c2-7e54ef7b2655 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:06.159619 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-15f90e61-c344-40e6-a9c2-7e54ef7b2655 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] HTTP exception thrown: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-15f90e61-c344-40e6-a9c2-7e54ef7b2655 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Request method failure captured: Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf/os-volume_attachments HTTP/1.1 Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWT2WDs19oy4h3COjVtSzDynRwA0tNhnm20kGubZDxDzplM1PSY_NrPnmq5lSVqyxouh609OJu0KYzmkp9B3wj0HMsKY2ObQO8yVdTcnvPd4mGeVpmkR0P5nKOcgiBVCOFvYO7r-T-qZF3jUqjGMt4rfNuoOMq38OVohLLvvR8-Kik4 Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 9bf90b4e09e94cc984fe36b03b08a0b6 Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-DeleteServersTestJSON-136378618 Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:18:06.163895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:18:06.166437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:18:06.166437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-DeleteServersTestJSON-136378618 Aug 30 01:18:06.166437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 9bf90b4e09e94cc984fe36b03b08a0b6 Aug 30 01:18:06.166437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-DeleteServersTestJSON-136378618 Aug 30 01:18:06.166437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-DeleteServersTestJSON-136378618-project Aug 30 01:18:06.166437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:18:06.166437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:18:06.166437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 5b2e7c46b6aa4800834115196866b244 Aug 30 01:18:06.166437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-DeleteServersTestJSON-136378618-project Aug 30 01:18:06.166437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:18:06.166437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:06.166437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'server_id': 'f3ae258e-1465-4b2c-be83-77db7a339adf'} Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:06.167188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:06.168479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:06.170616 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-15f90e61-c344-40e6-a9c2-7e54ef7b2655 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Returning 404 to user: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:06.170616 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-15f90e61-c344-40e6-a9c2-7e54ef7b2655 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047805 Aug 30 01:18:06.170616 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 91/190] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:18:06 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:06.345524 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4e04d200-7bbc-42a8-a47d-1462016556a7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:06.346676 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4e04d200-7bbc-42a8-a47d-1462016556a7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:06.364701 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e04d200-7bbc-42a8-a47d-1462016556a7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:06.365270 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e04d200-7bbc-42a8-a47d-1462016556a7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:06.368652 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e04d200-7bbc-42a8-a47d-1462016556a7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:06.371590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e04d200-7bbc-42a8-a47d-1462016556a7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:06.372196 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e04d200-7bbc-42a8-a47d-1462016556a7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:06.373906 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e04d200-7bbc-42a8-a47d-1462016556a7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:06.618484 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1ae72c53-0633-480a-a170-1c136b22ea3c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:06.619629 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1ae72c53-0633-480a-a170-1c136b22ea3c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:06.643521 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1ae72c53-0633-480a-a170-1c136b22ea3c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:06.648283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1ae72c53-0633-480a-a170-1c136b22ea3c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:06.652343 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1ae72c53-0633-480a-a170-1c136b22ea3c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:06.654062 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1ae72c53-0633-480a-a170-1c136b22ea3c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:06.659258 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1ae72c53-0633-480a-a170-1c136b22ea3c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:06.659869 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1ae72c53-0633-480a-a170-1c136b22ea3c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:06.732378 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4e04d200-7bbc-42a8-a47d-1462016556a7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:06.753268 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4e04d200-7bbc-42a8-a47d-1462016556a7 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1315 microversion: 2.1 time: 0.415019 Aug 30 01:18:06.756587 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 100/191] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:06 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:06.827473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-dfa9dd49-a8ff-4699-8d98-1da92b6a51ef req-07303d83-57ec-4619-b794-68d3bec24ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee5d11e5-e17e-4307-8bf7-9a00c5df8305", "name": "network-vif-plugged", "status": "completed", "tag": "6993fda7-c492-46dd-81de-aa2ee4acbfe5"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:06.844619 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-dfa9dd49-a8ff-4699-8d98-1da92b6a51ef req-07303d83-57ec-4619-b794-68d3bec24ef6 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:06.845581 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-dfa9dd49-a8ff-4699-8d98-1da92b6a51ef req-07303d83-57ec-4619-b794-68d3bec24ef6 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:06.846322 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-dfa9dd49-a8ff-4699-8d98-1da92b6a51ef req-07303d83-57ec-4619-b794-68d3bec24ef6 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:06.872901 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-dfa9dd49-a8ff-4699-8d98-1da92b6a51ef req-07303d83-57ec-4619-b794-68d3bec24ef6 service nova] Creating event network-vif-plugged:6993fda7-c492-46dd-81de-aa2ee4acbfe5 for instance ee5d11e5-e17e-4307-8bf7-9a00c5df8305 on hv-cinder-81514 Aug 30 01:18:06.881894 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-dfa9dd49-a8ff-4699-8d98-1da92b6a51ef req-07303d83-57ec-4619-b794-68d3bec24ef6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065165 Aug 30 01:18:06.884211 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 101/192] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:18:07.005778 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1ae72c53-0633-480a-a170-1c136b22ea3c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:07.017458 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1ae72c53-0633-480a-a170-1c136b22ea3c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1502 microversion: 2.1 time: 0.425430 Aug 30 01:18:07.018495 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 92/193] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:06 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1502 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:07.060206 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c7f2831c-4625-48ee-a9eb-d32f883f31b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:07.062315 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c7f2831c-4625-48ee-a9eb-d32f883f31b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:07.075062 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c7f2831c-4625-48ee-a9eb-d32f883f31b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:07.075062 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c7f2831c-4625-48ee-a9eb-d32f883f31b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:07.075487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c7f2831c-4625-48ee-a9eb-d32f883f31b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:07.078584 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c7f2831c-4625-48ee-a9eb-d32f883f31b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:07.081719 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c7f2831c-4625-48ee-a9eb-d32f883f31b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:07.083942 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c7f2831c-4625-48ee-a9eb-d32f883f31b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:07.388225 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c7f2831c-4625-48ee-a9eb-d32f883f31b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:07.401763 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c7f2831c-4625-48ee-a9eb-d32f883f31b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1516 microversion: 2.1 time: 0.353959 Aug 30 01:18:07.402761 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 102/194] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:07 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1516 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:07.650536 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2cf731df-6211-4620-ba7a-887217ca83e6 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:07.655171 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2cf731df-6211-4620-ba7a-887217ca83e6 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:07.664159 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2cf731df-6211-4620-ba7a-887217ca83e6 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:07.665794 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2cf731df-6211-4620-ba7a-887217ca83e6 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:07.666482 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2cf731df-6211-4620-ba7a-887217ca83e6 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:07.667476 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2cf731df-6211-4620-ba7a-887217ca83e6 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:07.668114 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2cf731df-6211-4620-ba7a-887217ca83e6 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:07.668781 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2cf731df-6211-4620-ba7a-887217ca83e6 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:07.691983 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-2cf731df-6211-4620-ba7a-887217ca83e6 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] HTTP exception thrown: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2cf731df-6211-4620-ba7a-887217ca83e6 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Request method failure captured: Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: DELETE /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf HTTP/1.1 Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWT2WDs19oy4h3COjVtSzDynRwA0tNhnm20kGubZDxDzplM1PSY_NrPnmq5lSVqyxouh609OJu0KYzmkp9B3wj0HMsKY2ObQO8yVdTcnvPd4mGeVpmkR0P5nKOcgiBVCOFvYO7r-T-qZF3jUqjGMt4rfNuoOMq38OVohLLvvR8-Kik4 Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 9bf90b4e09e94cc984fe36b03b08a0b6 Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-DeleteServersTestJSON-136378618 Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:18:07.694644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:18:07.697918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:18:07.697918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-DeleteServersTestJSON-136378618 Aug 30 01:18:07.697918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 9bf90b4e09e94cc984fe36b03b08a0b6 Aug 30 01:18:07.697918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-DeleteServersTestJSON-136378618 Aug 30 01:18:07.697918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-DeleteServersTestJSON-136378618-project Aug 30 01:18:07.697918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:18:07.697918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:18:07.697918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 5b2e7c46b6aa4800834115196866b244 Aug 30 01:18:07.697918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-DeleteServersTestJSON-136378618-project Aug 30 01:18:07.697918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:18:07.697918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:07.697918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': 'f3ae258e-1465-4b2c-be83-77db7a339adf'} Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:07.698636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:07.699657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:07.702319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2cf731df-6211-4620-ba7a-887217ca83e6 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Returning 404 to user: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:07.705750 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2cf731df-6211-4620-ba7a-887217ca83e6 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 404 len: 111 microversion: 2.1 time: 0.063226 Aug 30 01:18:07.716731 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 93/195] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:18:07 2022] DELETE /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:07.726778 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-88f1622b-57b6-43d3-b594-a63a6bf03c52 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:07.727427 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-88f1622b-57b6-43d3-b594-a63a6bf03c52 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] [instance: f3ae258e-1465-4b2c-be83-77db7a339adf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:07.739296 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-88f1622b-57b6-43d3-b594-a63a6bf03c52 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:07.740039 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-88f1622b-57b6-43d3-b594-a63a6bf03c52 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:07.740652 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-88f1622b-57b6-43d3-b594-a63a6bf03c52 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:07.741539 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-88f1622b-57b6-43d3-b594-a63a6bf03c52 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:07.742164 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-88f1622b-57b6-43d3-b594-a63a6bf03c52 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:07.742589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-88f1622b-57b6-43d3-b594-a63a6bf03c52 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:07.761360 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-88f1622b-57b6-43d3-b594-a63a6bf03c52 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] HTTP exception thrown: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-88f1622b-57b6-43d3-b594-a63a6bf03c52 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Request method failure captured: Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf HTTP/1.1 Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWT2WDs19oy4h3COjVtSzDynRwA0tNhnm20kGubZDxDzplM1PSY_NrPnmq5lSVqyxouh609OJu0KYzmkp9B3wj0HMsKY2ObQO8yVdTcnvPd4mGeVpmkR0P5nKOcgiBVCOFvYO7r-T-qZF3jUqjGMt4rfNuoOMq38OVohLLvvR8-Kik4 Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: 9bf90b4e09e94cc984fe36b03b08a0b6 Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-DeleteServersTestJSON-136378618 Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:18:07.763589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:18:07.765230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9bf90b4e09e94cc984fe36b03b08a0b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:18:07.765230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-DeleteServersTestJSON-136378618 Aug 30 01:18:07.765230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 9bf90b4e09e94cc984fe36b03b08a0b6 Aug 30 01:18:07.765230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-DeleteServersTestJSON-136378618 Aug 30 01:18:07.765230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-DeleteServersTestJSON-136378618-project Aug 30 01:18:07.765230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:18:07.765230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:18:07.765230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 5b2e7c46b6aa4800834115196866b244 Aug 30 01:18:07.765230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-DeleteServersTestJSON-136378618-project Aug 30 01:18:07.765230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:18:07.765230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:07.765230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': 'f3ae258e-1465-4b2c-be83-77db7a339adf'} Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:07.765870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. Aug 30 01:18:07.767434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:07.770208 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-88f1622b-57b6-43d3-b594-a63a6bf03c52 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] Returning 404 to user: Instance f3ae258e-1465-4b2c-be83-77db7a339adf could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:07.771619 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-88f1622b-57b6-43d3-b594-a63a6bf03c52 tempest-DeleteServersTestJSON-136378618 tempest-DeleteServersTestJSON-136378618-project] 10.222.0.44 "GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf" status: 404 len: 111 microversion: 2.1 time: 0.049537 Aug 30 01:18:07.785981 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 103/196] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:07 2022] GET /compute/v2.1/servers/f3ae258e-1465-4b2c-be83-77db7a339adf => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:07.794422 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0de5422b-e67f-4244-8c83-69e9c37216e5 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:07.795277 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0de5422b-e67f-4244-8c83-69e9c37216e5 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:07.807030 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0de5422b-e67f-4244-8c83-69e9c37216e5 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:07.808283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0de5422b-e67f-4244-8c83-69e9c37216e5 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:07.811782 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0de5422b-e67f-4244-8c83-69e9c37216e5 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:07.815548 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0de5422b-e67f-4244-8c83-69e9c37216e5 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:07.816500 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0de5422b-e67f-4244-8c83-69e9c37216e5 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:07.817130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0de5422b-e67f-4244-8c83-69e9c37216e5 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:08.015225 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0de5422b-e67f-4244-8c83-69e9c37216e5 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:08.034077 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0de5422b-e67f-4244-8c83-69e9c37216e5 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1315 microversion: 2.1 time: 0.243926 Aug 30 01:18:08.034988 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 94/197] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:07 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:09.058529 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d803b9aa-15f8-4dc2-b7e9-e78c7831cfd4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:09.059170 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d803b9aa-15f8-4dc2-b7e9-e78c7831cfd4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:09.069921 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d803b9aa-15f8-4dc2-b7e9-e78c7831cfd4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:09.076717 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d803b9aa-15f8-4dc2-b7e9-e78c7831cfd4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:09.077181 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d803b9aa-15f8-4dc2-b7e9-e78c7831cfd4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:09.077942 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d803b9aa-15f8-4dc2-b7e9-e78c7831cfd4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:09.078434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d803b9aa-15f8-4dc2-b7e9-e78c7831cfd4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:09.080104 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d803b9aa-15f8-4dc2-b7e9-e78c7831cfd4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:09.319219 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-20d52033-5d07-45e4-84f1-8b57d4d75507 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:09.323700 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-20d52033-5d07-45e4-84f1-8b57d4d75507 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:09.344193 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20d52033-5d07-45e4-84f1-8b57d4d75507 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:09.345164 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20d52033-5d07-45e4-84f1-8b57d4d75507 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:09.345806 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20d52033-5d07-45e4-84f1-8b57d4d75507 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:09.346675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20d52033-5d07-45e4-84f1-8b57d4d75507 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:09.347240 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20d52033-5d07-45e4-84f1-8b57d4d75507 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:09.348320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20d52033-5d07-45e4-84f1-8b57d4d75507 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:09.408232 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-20d52033-5d07-45e4-84f1-8b57d4d75507 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lazy-loading 'flavor' on Instance uuid 26186b86-98dd-4907-8665-3358fa62eb1e {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:18:09.425852 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d803b9aa-15f8-4dc2-b7e9-e78c7831cfd4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:09.436922 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d803b9aa-15f8-4dc2-b7e9-e78c7831cfd4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1315 microversion: 2.1 time: 0.383266 Aug 30 01:18:09.438866 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 104/198] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:09 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:09.603743 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-20d52033-5d07-45e4-84f1-8b57d4d75507 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "POST /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e/action" status: 200 len: 32 microversion: 2.1 time: 0.289664 Aug 30 01:18:09.605986 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 95/199] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:18:09 2022] POST /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e/action => generated 32 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 01:18:09.616917 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1331796a-1593-4a3f-bdd5-abbd94353165 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:09.617873 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1331796a-1593-4a3f-bdd5-abbd94353165 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:09.632839 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1331796a-1593-4a3f-bdd5-abbd94353165 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:09.633343 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1331796a-1593-4a3f-bdd5-abbd94353165 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:09.633779 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1331796a-1593-4a3f-bdd5-abbd94353165 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:09.634494 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1331796a-1593-4a3f-bdd5-abbd94353165 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:09.636700 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1331796a-1593-4a3f-bdd5-abbd94353165 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:09.638034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1331796a-1593-4a3f-bdd5-abbd94353165 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:09.995465 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1331796a-1593-4a3f-bdd5-abbd94353165 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:10.007161 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1331796a-1593-4a3f-bdd5-abbd94353165 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.394146 Aug 30 01:18:10.007749 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 105/200] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:09 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:10.461711 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bf390f01-7606-49b2-8d39-9aa1eaf4ad2b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:10.463436 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bf390f01-7606-49b2-8d39-9aa1eaf4ad2b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:10.487982 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf390f01-7606-49b2-8d39-9aa1eaf4ad2b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:10.491974 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf390f01-7606-49b2-8d39-9aa1eaf4ad2b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:10.492853 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf390f01-7606-49b2-8d39-9aa1eaf4ad2b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:10.493738 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf390f01-7606-49b2-8d39-9aa1eaf4ad2b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:10.495431 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf390f01-7606-49b2-8d39-9aa1eaf4ad2b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:10.496396 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf390f01-7606-49b2-8d39-9aa1eaf4ad2b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:10.844359 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bf390f01-7606-49b2-8d39-9aa1eaf4ad2b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:10.859191 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bf390f01-7606-49b2-8d39-9aa1eaf4ad2b tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1465 microversion: 2.1 time: 0.403875 Aug 30 01:18:10.859808 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 96/201] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:10 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1465 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:10.925406 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f50642d9-bf57-4f64-afbf-58a7044bace6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:10.926234 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f50642d9-bf57-4f64-afbf-58a7044bace6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:10.933862 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f50642d9-bf57-4f64-afbf-58a7044bace6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:10.934661 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f50642d9-bf57-4f64-afbf-58a7044bace6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:10.935335 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f50642d9-bf57-4f64-afbf-58a7044bace6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:10.936271 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f50642d9-bf57-4f64-afbf-58a7044bace6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:10.936977 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f50642d9-bf57-4f64-afbf-58a7044bace6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:10.937591 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f50642d9-bf57-4f64-afbf-58a7044bace6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:10.997751 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f50642d9-bf57-4f64-afbf-58a7044bace6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:18:11.035649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-af48d753-68de-4ebe-9b4d-48cb3a9a8a1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:11.036530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-af48d753-68de-4ebe-9b4d-48cb3a9a8a1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:11.047150 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af48d753-68de-4ebe-9b4d-48cb3a9a8a1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:11.053295 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af48d753-68de-4ebe-9b4d-48cb3a9a8a1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:11.054085 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af48d753-68de-4ebe-9b4d-48cb3a9a8a1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:11.055584 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af48d753-68de-4ebe-9b4d-48cb3a9a8a1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:11.057561 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af48d753-68de-4ebe-9b4d-48cb3a9a8a1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:11.058777 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af48d753-68de-4ebe-9b4d-48cb3a9a8a1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:11.145937 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f50642d9-bf57-4f64-afbf-58a7044bace6 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 204 len: 0 microversion: 2.1 time: 0.225812 Aug 30 01:18:11.147384 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 106/202] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:18:10 2022] DELETE /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:18:11.158084 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0ae5c496-70f9-4897-8399-9770e0523b2d tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:11.160031 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0ae5c496-70f9-4897-8399-9770e0523b2d tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:11.168338 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ae5c496-70f9-4897-8399-9770e0523b2d tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:11.169164 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ae5c496-70f9-4897-8399-9770e0523b2d tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:11.169925 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ae5c496-70f9-4897-8399-9770e0523b2d tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:11.170982 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ae5c496-70f9-4897-8399-9770e0523b2d tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:11.171615 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ae5c496-70f9-4897-8399-9770e0523b2d tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:11.172219 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ae5c496-70f9-4897-8399-9770e0523b2d tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:11.457492 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0ae5c496-70f9-4897-8399-9770e0523b2d tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:11.471714 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0ae5c496-70f9-4897-8399-9770e0523b2d tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1471 microversion: 2.1 time: 0.318912 Aug 30 01:18:11.473049 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 107/203] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:11 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1471 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:11.976342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-af48d753-68de-4ebe-9b4d-48cb3a9a8a1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:12.004334 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-af48d753-68de-4ebe-9b4d-48cb3a9a8a1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.968300 Aug 30 01:18:12.004464 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 97/204] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:11 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:12.496559 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-77881d44-1bb0-4b7a-a17a-aecfbd258dab tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:12.497180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-77881d44-1bb0-4b7a-a17a-aecfbd258dab tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:12.504732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77881d44-1bb0-4b7a-a17a-aecfbd258dab tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:12.505218 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77881d44-1bb0-4b7a-a17a-aecfbd258dab tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:12.505662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77881d44-1bb0-4b7a-a17a-aecfbd258dab tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:12.506352 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77881d44-1bb0-4b7a-a17a-aecfbd258dab tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:12.507183 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77881d44-1bb0-4b7a-a17a-aecfbd258dab tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:12.507831 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77881d44-1bb0-4b7a-a17a-aecfbd258dab tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:13.025637 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b9815fe4-3858-41f1-a71c-d089c182355f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:13.027980 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-77881d44-1bb0-4b7a-a17a-aecfbd258dab tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:13.030084 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b9815fe4-3858-41f1-a71c-d089c182355f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:13.033064 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:13.039987 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-77881d44-1bb0-4b7a-a17a-aecfbd258dab tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1471 microversion: 2.1 time: 0.547501 Aug 30 01:18:13.041019 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 108/205] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:12 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1471 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:13.065966 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b9815fe4-3858-41f1-a71c-d089c182355f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:13.066599 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b9815fe4-3858-41f1-a71c-d089c182355f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:13.067070 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b9815fe4-3858-41f1-a71c-d089c182355f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:13.067814 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b9815fe4-3858-41f1-a71c-d089c182355f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:13.068305 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b9815fe4-3858-41f1-a71c-d089c182355f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:13.068732 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b9815fe4-3858-41f1-a71c-d089c182355f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:13.516781 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b9815fe4-3858-41f1-a71c-d089c182355f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:13.530668 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b9815fe4-3858-41f1-a71c-d089c182355f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.513305 Aug 30 01:18:13.531262 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 98/206] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:13 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:14.068663 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0575d2d5-30b4-4168-b59a-2d247911abb1 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:14.074871 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0575d2d5-30b4-4168-b59a-2d247911abb1 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:14.116188 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0575d2d5-30b4-4168-b59a-2d247911abb1 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:14.120302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0575d2d5-30b4-4168-b59a-2d247911abb1 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:14.120875 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0575d2d5-30b4-4168-b59a-2d247911abb1 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:14.127211 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0575d2d5-30b4-4168-b59a-2d247911abb1 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:14.127718 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0575d2d5-30b4-4168-b59a-2d247911abb1 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:14.128314 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0575d2d5-30b4-4168-b59a-2d247911abb1 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:14.533470 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0575d2d5-30b4-4168-b59a-2d247911abb1 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:14.568657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-db9d12cd-0310-4d24-b9b9-29ff18da6071 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:14.572167 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-db9d12cd-0310-4d24-b9b9-29ff18da6071 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:14.582223 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0575d2d5-30b4-4168-b59a-2d247911abb1 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1471 microversion: 2.1 time: 0.520302 Aug 30 01:18:14.587938 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 109/207] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:14 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1471 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:14.598321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db9d12cd-0310-4d24-b9b9-29ff18da6071 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:14.598978 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db9d12cd-0310-4d24-b9b9-29ff18da6071 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:14.599625 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db9d12cd-0310-4d24-b9b9-29ff18da6071 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:14.600562 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db9d12cd-0310-4d24-b9b9-29ff18da6071 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:14.601164 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db9d12cd-0310-4d24-b9b9-29ff18da6071 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:14.601866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db9d12cd-0310-4d24-b9b9-29ff18da6071 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:15.454657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-db9d12cd-0310-4d24-b9b9-29ff18da6071 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:15.472224 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-db9d12cd-0310-4d24-b9b9-29ff18da6071 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.920539 Aug 30 01:18:15.473694 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-c12fb83e-3ae8-42ba-a8f5-57eb20f116ef req-fd343813-2da7-4987-8d90-aabf07f62919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee5d11e5-e17e-4307-8bf7-9a00c5df8305", "name": "network-vif-deleted", "tag": "6993fda7-c492-46dd-81de-aa2ee4acbfe5"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:15.475645 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 99/208] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:14 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:15.536054 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-c12fb83e-3ae8-42ba-a8f5-57eb20f116ef req-fd343813-2da7-4987-8d90-aabf07f62919 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:15.536541 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-c12fb83e-3ae8-42ba-a8f5-57eb20f116ef req-fd343813-2da7-4987-8d90-aabf07f62919 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:15.537201 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-c12fb83e-3ae8-42ba-a8f5-57eb20f116ef req-fd343813-2da7-4987-8d90-aabf07f62919 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:15.557164 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-c12fb83e-3ae8-42ba-a8f5-57eb20f116ef req-fd343813-2da7-4987-8d90-aabf07f62919 service nova] Creating event network-vif-deleted:6993fda7-c492-46dd-81de-aa2ee4acbfe5 for instance ee5d11e5-e17e-4307-8bf7-9a00c5df8305 on hv-cinder-81514 Aug 30 01:18:15.573898 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-c12fb83e-3ae8-42ba-a8f5-57eb20f116ef req-fd343813-2da7-4987-8d90-aabf07f62919 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105972 Aug 30 01:18:15.577906 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 110/209] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:18:15.615259 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:15.616431 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:15.654650 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:15.655281 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:15.656376 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:15.658948 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:15.659796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:15.662832 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:15.805148 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:15.806779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:15.809034 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:15.809710 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lazy-loading 'fault' on Instance uuid ee5d11e5-e17e-4307-8bf7-9a00c5df8305 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:18:15.947228 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d34f688d0b94401a1907e9845a61fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585255dc2f0344dbbad821bf1110cda5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:15.959606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-119f7886-31bd-4cc9-b091-07facff0f6e4 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 200 len: 1305 microversion: 2.1 time: 0.354217 Aug 30 01:18:15.960295 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 100/210] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:15 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 1305 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:16.343804 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1005487395", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "networks": [{"uuid": "3e2aeb58-3a7d-4703-af37-5e4bc1626f59"}]}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:16.474219 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] validate_networks() for [('3e2aeb58-3a7d-4703-af37-5e4bc1626f59', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:18:16.503783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5ba817c2-dbab-42cd-bf08-3d6e6acb8691 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:16.504577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5ba817c2-dbab-42cd-bf08-3d6e6acb8691 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:16.514017 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5ba817c2-dbab-42cd-bf08-3d6e6acb8691 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:16.517399 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5ba817c2-dbab-42cd-bf08-3d6e6acb8691 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:16.518074 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5ba817c2-dbab-42cd-bf08-3d6e6acb8691 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:16.518841 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5ba817c2-dbab-42cd-bf08-3d6e6acb8691 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:16.519300 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5ba817c2-dbab-42cd-bf08-3d6e6acb8691 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:16.519945 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5ba817c2-dbab-42cd-bf08-3d6e6acb8691 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:16.558389 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:16.842810 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5ba817c2-dbab-42cd-bf08-3d6e6acb8691 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:16.864114 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5ba817c2-dbab-42cd-bf08-3d6e6acb8691 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.364860 Aug 30 01:18:16.876738 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 101/211] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:16 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:16.983617 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9037ec97-688f-4ddc-a445-5ca85a8b6bd8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:16.985494 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9037ec97-688f-4ddc-a445-5ca85a8b6bd8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] [instance: ee5d11e5-e17e-4307-8bf7-9a00c5df8305] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:16.992868 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9037ec97-688f-4ddc-a445-5ca85a8b6bd8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:16.993734 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9037ec97-688f-4ddc-a445-5ca85a8b6bd8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:16.994222 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9037ec97-688f-4ddc-a445-5ca85a8b6bd8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:16.995103 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9037ec97-688f-4ddc-a445-5ca85a8b6bd8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:16.995550 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9037ec97-688f-4ddc-a445-5ca85a8b6bd8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:16.996126 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9037ec97-688f-4ddc-a445-5ca85a8b6bd8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:17.030641 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-9037ec97-688f-4ddc-a445-5ca85a8b6bd8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] HTTP exception thrown: Instance ee5d11e5-e17e-4307-8bf7-9a00c5df8305 could not be found. Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9037ec97-688f-4ddc-a445-5ca85a8b6bd8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Request method failure captured: Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 HTTP/1.1 Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWU5__Bulpe175eMkelqIcw4dWK_xCVq78h3fwdvjJT1bLzUqHDaqALUyEWg4xIDLQty_NZ_50A7_kApZH4n5uGlCOxSklBMMjciZc_9dvKu1DfX-BwwPU8CH56RurVTn7552yCgCa01MN3V_cDV6XxAOC8SccQTeVA5aOo1OiWg1D8 Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 585255dc2f0344dbbad821bf1110cda5 Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesNegativeTest-1232821623 Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:18:17.035320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:18:17.037995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/585255dc2f0344dbbad821bf1110cda5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/585255dc2f0344dbbad821bf1110cda5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/585255dc2f0344dbbad821bf1110cda5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_585255dc2f0344dbbad821bf1110cda5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:18:17.037995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesNegativeTest-1232821623 Aug 30 01:18:17.037995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 585255dc2f0344dbbad821bf1110cda5 Aug 30 01:18:17.037995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesNegativeTest-1232821623 Aug 30 01:18:17.037995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesNegativeTest-1232821623-project Aug 30 01:18:17.037995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:18:17.037995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:18:17.037995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 1d34f688d0b94401a1907e9845a61fc5 Aug 30 01:18:17.037995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesNegativeTest-1232821623-project Aug 30 01:18:17.037995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:18:17.037995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance ee5d11e5-e17e-4307-8bf7-9a00c5df8305 could not be found. Aug 30 01:18:17.037995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': 'ee5d11e5-e17e-4307-8bf7-9a00c5df8305'} Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee5d11e5-e17e-4307-8bf7-9a00c5df8305 could not be found. Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:17.039279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee5d11e5-e17e-4307-8bf7-9a00c5df8305 could not be found. Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee5d11e5-e17e-4307-8bf7-9a00c5df8305 could not be found. Aug 30 01:18:17.041427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:18:17.049782 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9037ec97-688f-4ddc-a445-5ca85a8b6bd8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] Returning 404 to user: Instance ee5d11e5-e17e-4307-8bf7-9a00c5df8305 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:17.051519 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9037ec97-688f-4ddc-a445-5ca85a8b6bd8 tempest-VolumesNegativeTest-1232821623 tempest-VolumesNegativeTest-1232821623-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305" status: 404 len: 111 microversion: 2.1 time: 0.072867 Aug 30 01:18:17.053026 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 102/212] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:16 2022] GET /compute/v2.1/servers/ee5d11e5-e17e-4307-8bf7-9a00c5df8305 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:18:17.200577 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:18:17.201345 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:18:17.201499 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:18:17.201887 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:18:17.202283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:18:17.224112 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:17.224881 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:17.225563 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:17.227004 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:17.227586 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:17.228790 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:17.262683 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Getting quotas for project 2815adc7e64040c8986b1bd3f4519343. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:18:17.268655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Getting quotas for user 64b579837fb4434282224eb7b83e57ab and project 2815adc7e64040c8986b1bd3f4519343. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:18:17.285461 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:18:17.287961 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:18:17.365355 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-46a12e05-d784-4206-a6e0-7c2c396fb3ef tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030638 Aug 30 01:18:17.367011 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 111/213] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:18:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:18:17.386495 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-267b326d-2a03-4a33-a6b5-d216d9b37f48 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:17.388034 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-267b326d-2a03-4a33-a6b5-d216d9b37f48 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:17.504990 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-267b326d-2a03-4a33-a6b5-d216d9b37f48 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:17.518283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-267b326d-2a03-4a33-a6b5-d216d9b37f48 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1219 microversion: 2.1 time: 0.138896 Aug 30 01:18:17.537522 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 103/214] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:17 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:17.902098 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d17904bc-074f-4433-a7b9-ee7602919b98 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:17.904392 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d17904bc-074f-4433-a7b9-ee7602919b98 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:17.918887 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d17904bc-074f-4433-a7b9-ee7602919b98 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:17.920922 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d17904bc-074f-4433-a7b9-ee7602919b98 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:17.922675 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d17904bc-074f-4433-a7b9-ee7602919b98 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:17.924661 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d17904bc-074f-4433-a7b9-ee7602919b98 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:17.925798 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d17904bc-074f-4433-a7b9-ee7602919b98 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:17.926855 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d17904bc-074f-4433-a7b9-ee7602919b98 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:18.317771 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d17904bc-074f-4433-a7b9-ee7602919b98 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:18.345779 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d17904bc-074f-4433-a7b9-ee7602919b98 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.450052 Aug 30 01:18:18.348401 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 112/215] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:17 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:18.565283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9d4e4a8d-2bb7-435f-9567-95652a605c21 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:18.569381 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9d4e4a8d-2bb7-435f-9567-95652a605c21 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:18.596584 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d4e4a8d-2bb7-435f-9567-95652a605c21 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:18.597530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d4e4a8d-2bb7-435f-9567-95652a605c21 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:18.598204 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d4e4a8d-2bb7-435f-9567-95652a605c21 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:18.599397 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d4e4a8d-2bb7-435f-9567-95652a605c21 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:18.600080 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d4e4a8d-2bb7-435f-9567-95652a605c21 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:18.601098 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d4e4a8d-2bb7-435f-9567-95652a605c21 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:18.863006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9d4e4a8d-2bb7-435f-9567-95652a605c21 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:18.894791 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9d4e4a8d-2bb7-435f-9567-95652a605c21 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1215 microversion: 2.1 time: 0.341439 Aug 30 01:18:18.895916 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 104/216] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:18 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1215 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:19.384132 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3486912d-e3ad-4921-9949-eb34b754be7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:19.385022 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3486912d-e3ad-4921-9949-eb34b754be7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:19.393355 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3486912d-e3ad-4921-9949-eb34b754be7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:19.393846 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3486912d-e3ad-4921-9949-eb34b754be7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:19.394308 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3486912d-e3ad-4921-9949-eb34b754be7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:19.401289 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3486912d-e3ad-4921-9949-eb34b754be7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:19.401820 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3486912d-e3ad-4921-9949-eb34b754be7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:19.402222 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3486912d-e3ad-4921-9949-eb34b754be7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:19.559443 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3486912d-e3ad-4921-9949-eb34b754be7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:19.570154 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3486912d-e3ad-4921-9949-eb34b754be7c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.190329 Aug 30 01:18:19.570745 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 113/217] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:19 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:19.930009 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-af21b2d0-ca49-41b0-9d2d-90e52bdd15f3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:19.931533 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-af21b2d0-ca49-41b0-9d2d-90e52bdd15f3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:19.942675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af21b2d0-ca49-41b0-9d2d-90e52bdd15f3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:19.943960 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af21b2d0-ca49-41b0-9d2d-90e52bdd15f3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:19.944833 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af21b2d0-ca49-41b0-9d2d-90e52bdd15f3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:19.945968 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af21b2d0-ca49-41b0-9d2d-90e52bdd15f3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:19.947191 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af21b2d0-ca49-41b0-9d2d-90e52bdd15f3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:19.948117 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af21b2d0-ca49-41b0-9d2d-90e52bdd15f3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:20.359077 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-af21b2d0-ca49-41b0-9d2d-90e52bdd15f3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:20.381182 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-af21b2d0-ca49-41b0-9d2d-90e52bdd15f3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1279 microversion: 2.1 time: 0.455400 Aug 30 01:18:20.382528 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 105/218] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:19 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1279 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:20.612712 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5126f709-dc1d-47fe-8fb8-e4bdbe5deeab tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:20.616396 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5126f709-dc1d-47fe-8fb8-e4bdbe5deeab tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:20.629356 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5126f709-dc1d-47fe-8fb8-e4bdbe5deeab tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:20.630107 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5126f709-dc1d-47fe-8fb8-e4bdbe5deeab tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:20.631024 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5126f709-dc1d-47fe-8fb8-e4bdbe5deeab tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:20.632269 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5126f709-dc1d-47fe-8fb8-e4bdbe5deeab tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:20.633115 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5126f709-dc1d-47fe-8fb8-e4bdbe5deeab tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:20.633860 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5126f709-dc1d-47fe-8fb8-e4bdbe5deeab tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:20.800176 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5126f709-dc1d-47fe-8fb8-e4bdbe5deeab tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:20.812872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5126f709-dc1d-47fe-8fb8-e4bdbe5deeab tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.209435 Aug 30 01:18:20.816052 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 114/219] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:20 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:20.939708 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-122f3e6f-5bbd-4f9f-bed5-0cb475be5d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:20.940323 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-122f3e6f-5bbd-4f9f-bed5-0cb475be5d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:20.949752 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-122f3e6f-5bbd-4f9f-bed5-0cb475be5d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:20.950388 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-122f3e6f-5bbd-4f9f-bed5-0cb475be5d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:20.950861 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-122f3e6f-5bbd-4f9f-bed5-0cb475be5d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:20.951864 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-122f3e6f-5bbd-4f9f-bed5-0cb475be5d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:20.952661 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-122f3e6f-5bbd-4f9f-bed5-0cb475be5d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:20.953437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-122f3e6f-5bbd-4f9f-bed5-0cb475be5d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:20.991240 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-122f3e6f-5bbd-4f9f-bed5-0cb475be5d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/ips" status: 200 len: 146 microversion: 2.1 time: 0.055578 Aug 30 01:18:21.000261 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 106/220] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Aug 30 01:18:20 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/ips => generated 146 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:21.407773 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d19b8156-86c7-4a5b-8206-3742662b0044 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:21.408630 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d19b8156-86c7-4a5b-8206-3742662b0044 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:21.421363 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d19b8156-86c7-4a5b-8206-3742662b0044 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:21.422062 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d19b8156-86c7-4a5b-8206-3742662b0044 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:21.422500 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d19b8156-86c7-4a5b-8206-3742662b0044 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:21.423243 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d19b8156-86c7-4a5b-8206-3742662b0044 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:21.423705 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d19b8156-86c7-4a5b-8206-3742662b0044 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:21.427381 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d19b8156-86c7-4a5b-8206-3742662b0044 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:21.712830 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d19b8156-86c7-4a5b-8206-3742662b0044 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:21.726280 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d19b8156-86c7-4a5b-8206-3742662b0044 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1319 microversion: 2.1 time: 0.322676 Aug 30 01:18:21.727935 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 115/221] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:21 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:21.840862 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-302ea399-2f11-4fc1-b83c-44f547d5c2e7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:21.843392 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-302ea399-2f11-4fc1-b83c-44f547d5c2e7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:21.854610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-302ea399-2f11-4fc1-b83c-44f547d5c2e7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:21.855394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-302ea399-2f11-4fc1-b83c-44f547d5c2e7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:21.856347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-302ea399-2f11-4fc1-b83c-44f547d5c2e7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:21.858666 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-302ea399-2f11-4fc1-b83c-44f547d5c2e7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:21.860577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-302ea399-2f11-4fc1-b83c-44f547d5c2e7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:21.860846 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-302ea399-2f11-4fc1-b83c-44f547d5c2e7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:22.189050 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-302ea399-2f11-4fc1-b83c-44f547d5c2e7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:22.202428 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-302ea399-2f11-4fc1-b83c-44f547d5c2e7 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.368046 Aug 30 01:18:22.203764 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 107/222] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:21 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:22.553397 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-abfb3564-af65-4ef5-9b72-6a9c28d23df6 req-c73c2727-eb35-4ad3-aba6-7de5956b95ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89032f52-7c5b-4ce4-bbb5-9358b2c1f80f", "tag": "83d95f9d-945b-4916-bdf9-c95d4a1fd537"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:22.577954 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-abfb3564-af65-4ef5-9b72-6a9c28d23df6 req-c73c2727-eb35-4ad3-aba6-7de5956b95ba service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:22.579729 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-abfb3564-af65-4ef5-9b72-6a9c28d23df6 req-c73c2727-eb35-4ad3-aba6-7de5956b95ba service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:22.580983 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-abfb3564-af65-4ef5-9b72-6a9c28d23df6 req-c73c2727-eb35-4ad3-aba6-7de5956b95ba service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:22.607917 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-abfb3564-af65-4ef5-9b72-6a9c28d23df6 req-c73c2727-eb35-4ad3-aba6-7de5956b95ba service nova] Creating event network-changed:83d95f9d-945b-4916-bdf9-c95d4a1fd537 for instance 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f on hv-cinder-81514 Aug 30 01:18:22.623847 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-abfb3564-af65-4ef5-9b72-6a9c28d23df6 req-c73c2727-eb35-4ad3-aba6-7de5956b95ba service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074000 Aug 30 01:18:22.627546 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 116/223] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:22.753213 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-31fff87c-614f-481e-a771-73b32e84c7a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:22.754783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-31fff87c-614f-481e-a771-73b32e84c7a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:22.769516 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-31fff87c-614f-481e-a771-73b32e84c7a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:22.770304 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-31fff87c-614f-481e-a771-73b32e84c7a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:22.771932 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-31fff87c-614f-481e-a771-73b32e84c7a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:22.774879 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-31fff87c-614f-481e-a771-73b32e84c7a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:22.775627 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-31fff87c-614f-481e-a771-73b32e84c7a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:22.777185 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-31fff87c-614f-481e-a771-73b32e84c7a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:23.223027 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-31fff87c-614f-481e-a771-73b32e84c7a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:23.233691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-31fff87c-614f-481e-a771-73b32e84c7a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1319 microversion: 2.1 time: 0.486549 Aug 30 01:18:23.244458 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 108/224] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:22 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1319 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:23.244738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2825103f-c85c-4b21-8c84-9076ec02ba0b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:23.244738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2825103f-c85c-4b21-8c84-9076ec02ba0b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:23.277880 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2825103f-c85c-4b21-8c84-9076ec02ba0b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:23.280426 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2825103f-c85c-4b21-8c84-9076ec02ba0b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:23.283681 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2825103f-c85c-4b21-8c84-9076ec02ba0b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:23.290308 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2825103f-c85c-4b21-8c84-9076ec02ba0b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:23.292305 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2825103f-c85c-4b21-8c84-9076ec02ba0b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:23.293789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2825103f-c85c-4b21-8c84-9076ec02ba0b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:23.623390 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2825103f-c85c-4b21-8c84-9076ec02ba0b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:23.637354 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2825103f-c85c-4b21-8c84-9076ec02ba0b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.412012 Aug 30 01:18:23.638981 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 117/225] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:23 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:24.010064 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-889c169a-3026-412b-ae9a-a288e432a987 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a423953-1b7b-4dda-8b5b-c187488731ac"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:24.014791 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-889c169a-3026-412b-ae9a-a288e432a987 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:24.029426 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-889c169a-3026-412b-ae9a-a288e432a987 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:24.031376 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-889c169a-3026-412b-ae9a-a288e432a987 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:24.032262 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-889c169a-3026-412b-ae9a-a288e432a987 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:24.034189 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-889c169a-3026-412b-ae9a-a288e432a987 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:24.035027 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-889c169a-3026-412b-ae9a-a288e432a987 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:24.036042 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-889c169a-3026-412b-ae9a-a288e432a987 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:24.276174 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8b5edfc1-f25f-41bf-966a-e705d08d6a80 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:24.277061 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8b5edfc1-f25f-41bf-966a-e705d08d6a80 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:24.288379 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8b5edfc1-f25f-41bf-966a-e705d08d6a80 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:24.288379 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8b5edfc1-f25f-41bf-966a-e705d08d6a80 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:24.288379 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8b5edfc1-f25f-41bf-966a-e705d08d6a80 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:24.288379 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8b5edfc1-f25f-41bf-966a-e705d08d6a80 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:24.289113 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8b5edfc1-f25f-41bf-966a-e705d08d6a80 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:24.289113 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8b5edfc1-f25f-41bf-966a-e705d08d6a80 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:24.504914 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8b5edfc1-f25f-41bf-966a-e705d08d6a80 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:24.522057 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8b5edfc1-f25f-41bf-966a-e705d08d6a80 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1319 microversion: 2.1 time: 0.249828 Aug 30 01:18:24.523201 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 118/226] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:24 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:24.724725 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ef18d38b-c8c4-4a90-8021-3b2ff0285239 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:24.734682 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ef18d38b-c8c4-4a90-8021-3b2ff0285239 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:24.771673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef18d38b-c8c4-4a90-8021-3b2ff0285239 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:24.776646 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef18d38b-c8c4-4a90-8021-3b2ff0285239 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:24.777773 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef18d38b-c8c4-4a90-8021-3b2ff0285239 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:24.781317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef18d38b-c8c4-4a90-8021-3b2ff0285239 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:24.787290 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef18d38b-c8c4-4a90-8021-3b2ff0285239 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:24.790363 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef18d38b-c8c4-4a90-8021-3b2ff0285239 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:25.282661 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ef18d38b-c8c4-4a90-8021-3b2ff0285239 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:25.311799 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ef18d38b-c8c4-4a90-8021-3b2ff0285239 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.634008 Aug 30 01:18:25.312901 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 119/227] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:24 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:25.434499 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-889c169a-3026-412b-ae9a-a288e432a987 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "POST /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.432248 Aug 30 01:18:25.435788 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 109/228] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:18:23 2022] POST /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/os-volume_attachments => generated 194 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:25.549937 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b1fd0d08-12a7-42a8-b716-d55c2bd4540c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:25.553081 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b1fd0d08-12a7-42a8-b716-d55c2bd4540c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:25.578380 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b1fd0d08-12a7-42a8-b716-d55c2bd4540c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:25.580338 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b1fd0d08-12a7-42a8-b716-d55c2bd4540c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:25.581467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b1fd0d08-12a7-42a8-b716-d55c2bd4540c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:25.582593 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b1fd0d08-12a7-42a8-b716-d55c2bd4540c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:25.583314 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b1fd0d08-12a7-42a8-b716-d55c2bd4540c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:25.583986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b1fd0d08-12a7-42a8-b716-d55c2bd4540c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:25.804707 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b1fd0d08-12a7-42a8-b716-d55c2bd4540c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:25.818904 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b1fd0d08-12a7-42a8-b716-d55c2bd4540c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1319 microversion: 2.1 time: 0.275754 Aug 30 01:18:25.822926 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 120/229] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:25 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:26.342777 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8d033a51-eb58-403b-a7b2-ddc83f5d372a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:26.343816 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8d033a51-eb58-403b-a7b2-ddc83f5d372a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:26.356518 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d033a51-eb58-403b-a7b2-ddc83f5d372a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:26.358077 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d033a51-eb58-403b-a7b2-ddc83f5d372a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:26.358643 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d033a51-eb58-403b-a7b2-ddc83f5d372a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:26.360418 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d033a51-eb58-403b-a7b2-ddc83f5d372a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:26.360979 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d033a51-eb58-403b-a7b2-ddc83f5d372a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:26.361424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d033a51-eb58-403b-a7b2-ddc83f5d372a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:26.845168 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-751b4f19-1968-44f1-a37d-fe87cb033fbc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:26.847724 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-751b4f19-1968-44f1-a37d-fe87cb033fbc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:26.867044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-751b4f19-1968-44f1-a37d-fe87cb033fbc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:26.871137 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-751b4f19-1968-44f1-a37d-fe87cb033fbc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:26.875565 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-751b4f19-1968-44f1-a37d-fe87cb033fbc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:26.876831 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-751b4f19-1968-44f1-a37d-fe87cb033fbc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:26.877546 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-751b4f19-1968-44f1-a37d-fe87cb033fbc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:26.878197 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-751b4f19-1968-44f1-a37d-fe87cb033fbc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:26.941888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d033a51-eb58-403b-a7b2-ddc83f5d372a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:26.979512 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8d033a51-eb58-403b-a7b2-ddc83f5d372a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.635005 Aug 30 01:18:26.980829 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 110/230] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:26 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:27.241262 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:27.279631 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:27.294742 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-751b4f19-1968-44f1-a37d-fe87cb033fbc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:27.322706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-751b4f19-1968-44f1-a37d-fe87cb033fbc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1319 microversion: 2.1 time: 0.485468 Aug 30 01:18:27.345219 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 121/231] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:26 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1319 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:28.007445 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-95ca2d88-37c7-4fc2-8e54-c5202a32a860 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:28.008784 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-95ca2d88-37c7-4fc2-8e54-c5202a32a860 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:28.012475 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:28.017812 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95ca2d88-37c7-4fc2-8e54-c5202a32a860 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:28.018392 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95ca2d88-37c7-4fc2-8e54-c5202a32a860 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:28.019077 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95ca2d88-37c7-4fc2-8e54-c5202a32a860 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:28.019933 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95ca2d88-37c7-4fc2-8e54-c5202a32a860 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:28.020430 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95ca2d88-37c7-4fc2-8e54-c5202a32a860 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:28.020864 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95ca2d88-37c7-4fc2-8e54-c5202a32a860 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:28.362977 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6a03d9ef-b576-4df7-ba28-4f4f7a74e0e7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:28.363771 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6a03d9ef-b576-4df7-ba28-4f4f7a74e0e7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:28.372979 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-95ca2d88-37c7-4fc2-8e54-c5202a32a860 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:28.379512 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6a03d9ef-b576-4df7-ba28-4f4f7a74e0e7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:28.380415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6a03d9ef-b576-4df7-ba28-4f4f7a74e0e7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:28.381016 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6a03d9ef-b576-4df7-ba28-4f4f7a74e0e7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:28.381942 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6a03d9ef-b576-4df7-ba28-4f4f7a74e0e7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:28.382406 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6a03d9ef-b576-4df7-ba28-4f4f7a74e0e7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:28.382834 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6a03d9ef-b576-4df7-ba28-4f4f7a74e0e7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:28.383558 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-95ca2d88-37c7-4fc2-8e54-c5202a32a860 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.381911 Aug 30 01:18:28.397575 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 111/232] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:27 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:28.625609 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6a03d9ef-b576-4df7-ba28-4f4f7a74e0e7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:28.653418 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6a03d9ef-b576-4df7-ba28-4f4f7a74e0e7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1319 microversion: 2.1 time: 0.292107 Aug 30 01:18:28.658975 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 122/233] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:28 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:28.911250 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-a8681e3b-daaa-43d7-85b5-de5a7aa665c4 req-88e9a0dd-37a9-42a2-b75e-ca8a846f1159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89032f52-7c5b-4ce4-bbb5-9358b2c1f80f", "name": "network-vif-plugged", "status": "completed", "tag": "83d95f9d-945b-4916-bdf9-c95d4a1fd537"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:28.950446 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a8681e3b-daaa-43d7-85b5-de5a7aa665c4 req-88e9a0dd-37a9-42a2-b75e-ca8a846f1159 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:28.951819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a8681e3b-daaa-43d7-85b5-de5a7aa665c4 req-88e9a0dd-37a9-42a2-b75e-ca8a846f1159 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:28.955343 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a8681e3b-daaa-43d7-85b5-de5a7aa665c4 req-88e9a0dd-37a9-42a2-b75e-ca8a846f1159 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:29.007882 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-a8681e3b-daaa-43d7-85b5-de5a7aa665c4 req-88e9a0dd-37a9-42a2-b75e-ca8a846f1159 service nova] Creating event network-vif-plugged:83d95f9d-945b-4916-bdf9-c95d4a1fd537 for instance 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f on hv-cinder-81514 Aug 30 01:18:29.022022 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-a8681e3b-daaa-43d7-85b5-de5a7aa665c4 req-88e9a0dd-37a9-42a2-b75e-ca8a846f1159 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123967 Aug 30 01:18:29.023491 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 112/234] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:29.409563 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-480d9551-df98-4965-873d-8b2306a75c84 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:29.410397 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-480d9551-df98-4965-873d-8b2306a75c84 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:29.419889 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-480d9551-df98-4965-873d-8b2306a75c84 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:29.422532 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-480d9551-df98-4965-873d-8b2306a75c84 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:29.424290 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-480d9551-df98-4965-873d-8b2306a75c84 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:29.427524 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-480d9551-df98-4965-873d-8b2306a75c84 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:29.428220 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-480d9551-df98-4965-873d-8b2306a75c84 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:29.429775 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-480d9551-df98-4965-873d-8b2306a75c84 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:29.701452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e0bb9653-3b82-45da-a451-32defb9fee54 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:29.703349 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e0bb9653-3b82-45da-a451-32defb9fee54 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:29.715750 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0bb9653-3b82-45da-a451-32defb9fee54 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:29.716664 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0bb9653-3b82-45da-a451-32defb9fee54 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:29.717956 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0bb9653-3b82-45da-a451-32defb9fee54 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:29.723530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0bb9653-3b82-45da-a451-32defb9fee54 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:29.724334 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0bb9653-3b82-45da-a451-32defb9fee54 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:29.725723 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0bb9653-3b82-45da-a451-32defb9fee54 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:30.009609 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-480d9551-df98-4965-873d-8b2306a75c84 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:30.031332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-480d9551-df98-4965-873d-8b2306a75c84 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1502 microversion: 2.1 time: 0.624991 Aug 30 01:18:30.034798 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 123/235] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:29 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1502 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:30.073014 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e0bb9653-3b82-45da-a451-32defb9fee54 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:30.084655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e0bb9653-3b82-45da-a451-32defb9fee54 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1319 microversion: 2.1 time: 0.390857 Aug 30 01:18:30.100981 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9fa4a670-3dee-4b71-a425-0f3b5922003a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "844aa2d2-8dfb-4a71-9fd5-0e19c7438822"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:30.114568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9fa4a670-3dee-4b71-a425-0f3b5922003a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:30.115984 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 113/236] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:29 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:30.166657 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9fa4a670-3dee-4b71-a425-0f3b5922003a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:30.173494 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9fa4a670-3dee-4b71-a425-0f3b5922003a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:30.175313 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9fa4a670-3dee-4b71-a425-0f3b5922003a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:30.177406 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9fa4a670-3dee-4b71-a425-0f3b5922003a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:30.180401 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9fa4a670-3dee-4b71-a425-0f3b5922003a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:30.181748 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9fa4a670-3dee-4b71-a425-0f3b5922003a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:30.234012 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-9fa4a670-3dee-4b71-a425-0f3b5922003a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] HTTP exception thrown: Cannot 'attach_volume' instance 26186b86-98dd-4907-8665-3358fa62eb1e while it is in vm_state rescued Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9fa4a670-3dee-4b71-a425-0f3b5922003a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Request method failure captured: Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: POST /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e/os-volume_attachments HTTP/1.1 Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 74 Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWTyu2mYlr5SZBPqmuxeReqX8oUXqakHxF2IKof-fnI3tzgBe6Mk-AUTjC6A0JXOa4T6LtGD53koWf8oxieYjCOwBXRn6eJa2ckFuh7HaVg-Gba7cj6y-mZqMkJD3n-WhL5eNJRIXpizs-TyaFCR-XXy3d0GgG2JzExm_2cHDwfdcWE Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: adf47975f465467498be24ebe2c81ad7 Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:18:30.238302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:18:30.240868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_adf47975f465467498be24ebe2c81ad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:18:30.240868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:18:30.240868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: adf47975f465467498be24ebe2c81ad7 Aug 30 01:18:30.240868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:18:30.240868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-ServerRescueNegativeTestJSON-1122969509-project Aug 30 01:18:30.240868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:18:30.240868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:18:30.240868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 6d5a0cf37e3b4d3084a178f83642c144 Aug 30 01:18:30.240868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1122969509-project Aug 30 01:18:30.240868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Aug 30 01:18:30.240868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {"volumeAttachment": {"volumeId": "844aa2d2-8dfb-4a71-9fd5-0e19c7438822"}} Aug 30 01:18:30.240868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Cannot 'attach_volume' instance 26186b86-98dd-4907-8665-3358fa62eb1e while it is in vm_state rescued Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'server_id': '26186b86-98dd-4907-8665-3358fa62eb1e', 'body': {'volumeAttachment': {'volumeId': '844aa2d2-8dfb-4a71-9fd5-0e19c7438822'}}} Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 26186b86-98dd-4907-8665-3358fa62eb1e in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:30.242487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 26186b86-98dd-4907-8665-3358fa62eb1e while it is in vm_state rescued Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:30.246327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:30.249614 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:30.249614 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:30.249614 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 26186b86-98dd-4907-8665-3358fa62eb1e while it is in vm_state rescued Aug 30 01:18:30.249614 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:18:30.249614 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9fa4a670-3dee-4b71-a425-0f3b5922003a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Returning 409 to user: Cannot 'attach_volume' instance 26186b86-98dd-4907-8665-3358fa62eb1e while it is in vm_state rescued {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:30.249614 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9fa4a670-3dee-4b71-a425-0f3b5922003a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "POST /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.170406 Aug 30 01:18:30.249614 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 124/237] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:18:30 2022] POST /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e/os-volume_attachments => generated 152 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 01:18:30.252385 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0019a649-d443-4dc2-bec1-1ea0ca030325 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:30.252943 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0019a649-d443-4dc2-bec1-1ea0ca030325 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:30.259572 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0019a649-d443-4dc2-bec1-1ea0ca030325 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:30.260733 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0019a649-d443-4dc2-bec1-1ea0ca030325 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:30.261561 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0019a649-d443-4dc2-bec1-1ea0ca030325 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:30.262363 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0019a649-d443-4dc2-bec1-1ea0ca030325 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:30.262850 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0019a649-d443-4dc2-bec1-1ea0ca030325 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:30.263194 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0019a649-d443-4dc2-bec1-1ea0ca030325 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:30.385948 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0019a649-d443-4dc2-bec1-1ea0ca030325 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "POST /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e/action" status: 202 len: 0 microversion: 2.1 time: 0.138650 Aug 30 01:18:30.386855 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 114/238] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:18:30 2022] POST /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:18:30.397512 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a27f4830-1cef-4af6-8cdd-c14fe7281698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:30.398815 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a27f4830-1cef-4af6-8cdd-c14fe7281698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:30.407094 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a27f4830-1cef-4af6-8cdd-c14fe7281698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:30.407619 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a27f4830-1cef-4af6-8cdd-c14fe7281698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:30.408100 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a27f4830-1cef-4af6-8cdd-c14fe7281698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:30.408938 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a27f4830-1cef-4af6-8cdd-c14fe7281698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:30.409403 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a27f4830-1cef-4af6-8cdd-c14fe7281698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:30.409818 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a27f4830-1cef-4af6-8cdd-c14fe7281698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:30.699873 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a27f4830-1cef-4af6-8cdd-c14fe7281698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:30.712680 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a27f4830-1cef-4af6-8cdd-c14fe7281698 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1510 microversion: 2.1 time: 0.319645 Aug 30 01:18:30.713535 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 125/239] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:30 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1510 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:31.116039 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-42c19a58-84b9-42d1-89d6-ffd74909ca11 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:31.116744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-42c19a58-84b9-42d1-89d6-ffd74909ca11 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:31.127013 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42c19a58-84b9-42d1-89d6-ffd74909ca11 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:31.131411 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42c19a58-84b9-42d1-89d6-ffd74909ca11 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:31.133094 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42c19a58-84b9-42d1-89d6-ffd74909ca11 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:31.137801 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42c19a58-84b9-42d1-89d6-ffd74909ca11 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:31.138676 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42c19a58-84b9-42d1-89d6-ffd74909ca11 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:31.139912 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42c19a58-84b9-42d1-89d6-ffd74909ca11 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:31.377863 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-42c19a58-84b9-42d1-89d6-ffd74909ca11 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:31.386977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-42c19a58-84b9-42d1-89d6-ffd74909ca11 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1319 microversion: 2.1 time: 0.275663 Aug 30 01:18:31.401144 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 115/240] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:31 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:31.747720 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c4d3cfa0-5c40-48fe-9f84-d09050bc4813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:31.749168 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c4d3cfa0-5c40-48fe-9f84-d09050bc4813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:31.766006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c4d3cfa0-5c40-48fe-9f84-d09050bc4813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:31.767837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c4d3cfa0-5c40-48fe-9f84-d09050bc4813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:31.769494 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c4d3cfa0-5c40-48fe-9f84-d09050bc4813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:31.770832 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c4d3cfa0-5c40-48fe-9f84-d09050bc4813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:31.774260 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c4d3cfa0-5c40-48fe-9f84-d09050bc4813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:31.775027 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c4d3cfa0-5c40-48fe-9f84-d09050bc4813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:32.170598 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c4d3cfa0-5c40-48fe-9f84-d09050bc4813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:32.181022 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c4d3cfa0-5c40-48fe-9f84-d09050bc4813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1510 microversion: 2.1 time: 0.437944 Aug 30 01:18:32.183985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 126/241] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:31 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1510 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:32.411057 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-404f6f66-e456-4101-acca-253d86c55a00 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:32.412832 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-404f6f66-e456-4101-acca-253d86c55a00 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:32.453713 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=64 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:32.462380 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-404f6f66-e456-4101-acca-253d86c55a00 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:32.463884 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-404f6f66-e456-4101-acca-253d86c55a00 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:32.468803 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-404f6f66-e456-4101-acca-253d86c55a00 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:32.470141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-404f6f66-e456-4101-acca-253d86c55a00 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:32.473089 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-404f6f66-e456-4101-acca-253d86c55a00 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:32.473968 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-404f6f66-e456-4101-acca-253d86c55a00 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:32.954875 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-404f6f66-e456-4101-acca-253d86c55a00 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:32.967005 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-404f6f66-e456-4101-acca-253d86c55a00 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1508 microversion: 2.1 time: 0.560136 Aug 30 01:18:32.968218 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 116/242] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:32 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1508 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:33.213049 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ec0e9d24-a744-4f2f-abc7-81b9632cb2e8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:33.213837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ec0e9d24-a744-4f2f-abc7-81b9632cb2e8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:33.225900 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:33.251020 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ec0e9d24-a744-4f2f-abc7-81b9632cb2e8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:33.253997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ec0e9d24-a744-4f2f-abc7-81b9632cb2e8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:33.256434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ec0e9d24-a744-4f2f-abc7-81b9632cb2e8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:33.259608 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ec0e9d24-a744-4f2f-abc7-81b9632cb2e8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:33.260761 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ec0e9d24-a744-4f2f-abc7-81b9632cb2e8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:33.264240 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ec0e9d24-a744-4f2f-abc7-81b9632cb2e8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:33.993982 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ec0e9d24-a744-4f2f-abc7-81b9632cb2e8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:34.003261 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:34.007869 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ec0e9d24-a744-4f2f-abc7-81b9632cb2e8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1510 microversion: 2.1 time: 0.799413 Aug 30 01:18:34.009329 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 127/243] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:33 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1510 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:34.393130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6323c004-d7a0-4efd-8c14-4c40757e5bb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:34.439625 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6323c004-d7a0-4efd-8c14-4c40757e5bb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:34.441996 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6323c004-d7a0-4efd-8c14-4c40757e5bb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:34.442731 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6323c004-d7a0-4efd-8c14-4c40757e5bb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:34.615796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6323c004-d7a0-4efd-8c14-4c40757e5bb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Going to try to stop instance {{(pid=120706) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 01:18:34.723284 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:34.781762 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6323c004-d7a0-4efd-8c14-4c40757e5bb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "POST /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/action" status: 202 len: 0 microversion: 2.1 time: 0.391891 Aug 30 01:18:34.782851 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 117/244] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:18:34 2022] POST /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:18:34.796105 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c63f780a-361b-4dd8-b9f9-378bee564005 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:34.797080 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c63f780a-361b-4dd8-b9f9-378bee564005 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:34.808035 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c63f780a-361b-4dd8-b9f9-378bee564005 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:34.809244 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c63f780a-361b-4dd8-b9f9-378bee564005 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:34.809768 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c63f780a-361b-4dd8-b9f9-378bee564005 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:34.810766 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c63f780a-361b-4dd8-b9f9-378bee564005 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:34.811799 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c63f780a-361b-4dd8-b9f9-378bee564005 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:34.812429 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c63f780a-361b-4dd8-b9f9-378bee564005 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:35.037239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-56a50ab2-0e7b-4284-82d7-643eb357c00c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:35.038124 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-56a50ab2-0e7b-4284-82d7-643eb357c00c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:35.050460 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-56a50ab2-0e7b-4284-82d7-643eb357c00c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:35.051405 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-56a50ab2-0e7b-4284-82d7-643eb357c00c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:35.052152 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-56a50ab2-0e7b-4284-82d7-643eb357c00c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:35.053029 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-56a50ab2-0e7b-4284-82d7-643eb357c00c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:35.053655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-56a50ab2-0e7b-4284-82d7-643eb357c00c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:35.054458 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-56a50ab2-0e7b-4284-82d7-643eb357c00c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:35.190492 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c63f780a-361b-4dd8-b9f9-378bee564005 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:35.203464 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c63f780a-361b-4dd8-b9f9-378bee564005 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1723 microversion: 2.1 time: 0.414192 Aug 30 01:18:35.204598 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 128/245] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:34 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:35.311894 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-56a50ab2-0e7b-4284-82d7-643eb357c00c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:35.322320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-56a50ab2-0e7b-4284-82d7-643eb357c00c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1510 microversion: 2.1 time: 0.293691 Aug 30 01:18:35.323682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 118/246] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:35 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:36.229665 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0b1af226-3dac-4c60-abc1-133e66d44212 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:36.230558 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0b1af226-3dac-4c60-abc1-133e66d44212 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:36.272523 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b1af226-3dac-4c60-abc1-133e66d44212 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:36.273165 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b1af226-3dac-4c60-abc1-133e66d44212 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:36.276578 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b1af226-3dac-4c60-abc1-133e66d44212 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:36.278576 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b1af226-3dac-4c60-abc1-133e66d44212 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:36.279039 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b1af226-3dac-4c60-abc1-133e66d44212 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:36.281992 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b1af226-3dac-4c60-abc1-133e66d44212 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:36.358892 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-11bc7a63-90b0-47cb-b69a-f256fdcaf1cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:36.359630 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-11bc7a63-90b0-47cb-b69a-f256fdcaf1cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:36.372805 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11bc7a63-90b0-47cb-b69a-f256fdcaf1cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:36.381290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11bc7a63-90b0-47cb-b69a-f256fdcaf1cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:36.382168 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11bc7a63-90b0-47cb-b69a-f256fdcaf1cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:36.383453 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11bc7a63-90b0-47cb-b69a-f256fdcaf1cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:36.388571 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11bc7a63-90b0-47cb-b69a-f256fdcaf1cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:36.391174 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11bc7a63-90b0-47cb-b69a-f256fdcaf1cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:36.721069 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0b1af226-3dac-4c60-abc1-133e66d44212 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:36.743786 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0b1af226-3dac-4c60-abc1-133e66d44212 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1723 microversion: 2.1 time: 0.520554 Aug 30 01:18:36.746261 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 129/247] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:36 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1723 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:36.918615 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-11bc7a63-90b0-47cb-b69a-f256fdcaf1cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:36.957077 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-11bc7a63-90b0-47cb-b69a-f256fdcaf1cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1516 microversion: 2.1 time: 0.602294 Aug 30 01:18:36.959313 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 119/248] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:36 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1516 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:37.772311 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6ab78845-8d5e-47e5-86d2-2a262123ef41 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:37.774396 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6ab78845-8d5e-47e5-86d2-2a262123ef41 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:37.793525 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ab78845-8d5e-47e5-86d2-2a262123ef41 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:37.796725 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ab78845-8d5e-47e5-86d2-2a262123ef41 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:37.797921 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ab78845-8d5e-47e5-86d2-2a262123ef41 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:37.802580 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ab78845-8d5e-47e5-86d2-2a262123ef41 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:37.803725 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ab78845-8d5e-47e5-86d2-2a262123ef41 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:37.804917 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ab78845-8d5e-47e5-86d2-2a262123ef41 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:38.159853 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6ab78845-8d5e-47e5-86d2-2a262123ef41 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:38.185993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6ab78845-8d5e-47e5-86d2-2a262123ef41 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1723 microversion: 2.1 time: 0.418366 Aug 30 01:18:38.207433 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 130/249] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:37 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1723 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:39.233907 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-260e361b-565d-4ff9-bbca-7e6a0306879a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:39.236998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-260e361b-565d-4ff9-bbca-7e6a0306879a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:39.271701 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-260e361b-565d-4ff9-bbca-7e6a0306879a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:39.273814 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-260e361b-565d-4ff9-bbca-7e6a0306879a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:39.274787 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-260e361b-565d-4ff9-bbca-7e6a0306879a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:39.277708 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-260e361b-565d-4ff9-bbca-7e6a0306879a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:39.280274 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-260e361b-565d-4ff9-bbca-7e6a0306879a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:39.281790 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-260e361b-565d-4ff9-bbca-7e6a0306879a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:39.572571 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-260e361b-565d-4ff9-bbca-7e6a0306879a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:39.587062 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-260e361b-565d-4ff9-bbca-7e6a0306879a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1723 microversion: 2.1 time: 0.361016 Aug 30 01:18:39.599637 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 120/250] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:39 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:40.619081 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-10fbf92d-9572-4f88-b81d-2a373a9e1be6 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:40.620690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-10fbf92d-9572-4f88-b81d-2a373a9e1be6 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:40.656711 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-10fbf92d-9572-4f88-b81d-2a373a9e1be6 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:40.662635 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-10fbf92d-9572-4f88-b81d-2a373a9e1be6 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:40.663347 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-10fbf92d-9572-4f88-b81d-2a373a9e1be6 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:40.664233 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-10fbf92d-9572-4f88-b81d-2a373a9e1be6 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:40.664648 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-10fbf92d-9572-4f88-b81d-2a373a9e1be6 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:40.665091 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-10fbf92d-9572-4f88-b81d-2a373a9e1be6 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:40.906665 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c382dc97-258e-4182-9991-454aacc58f73 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Action: 'create', calling method: .version_select at 0x7ff48b121af0>, body: {"keypair": {"name": "tempest-keypair-1030540723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvnQCEI08i2gOVqQ0+xsyoKxhm1ZTbzg/jAkVFA/63uC4VrtkO/ZZ0iU5X2Hi/C5noLidmL65aIkeBJ8QQawXZoQz7tuGIbNByFOda+GPydNKmXe3/3CGeGypYG53rmoA=="}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:40.932395 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-10fbf92d-9572-4f88-b81d-2a373a9e1be6 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:40.948326 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-10fbf92d-9572-4f88-b81d-2a373a9e1be6 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1723 microversion: 2.1 time: 0.334379 Aug 30 01:18:40.952767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 131/251] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:40 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:41.028319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-c382dc97-258e-4182-9991-454aacc58f73 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Getting quotas for project adf47975f465467498be24ebe2c81ad7. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:18:41.038152 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-c382dc97-258e-4182-9991-454aacc58f73 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Getting quotas for user 6d5a0cf37e3b4d3084a178f83642c144 and project adf47975f465467498be24ebe2c81ad7. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:18:41.143858 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c382dc97-258e-4182-9991-454aacc58f73 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.244602 Aug 30 01:18:41.145305 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 121/252] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Aug 30 01:18:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:42.015633 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bcb2c1ff-2c23-4294-a4c3-ce5e5d9df1a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:42.018966 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bcb2c1ff-2c23-4294-a4c3-ce5e5d9df1a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:42.048043 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bcb2c1ff-2c23-4294-a4c3-ce5e5d9df1a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:42.049924 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bcb2c1ff-2c23-4294-a4c3-ce5e5d9df1a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:42.050402 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bcb2c1ff-2c23-4294-a4c3-ce5e5d9df1a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:42.051206 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bcb2c1ff-2c23-4294-a4c3-ce5e5d9df1a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:42.053267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bcb2c1ff-2c23-4294-a4c3-ce5e5d9df1a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:42.054193 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bcb2c1ff-2c23-4294-a4c3-ce5e5d9df1a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:42.537298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bcb2c1ff-2c23-4294-a4c3-ce5e5d9df1a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:42.595744 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bcb2c1ff-2c23-4294-a4c3-ce5e5d9df1a7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1723 microversion: 2.1 time: 0.578743 Aug 30 01:18:42.616050 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 132/253] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:41 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1723 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:43.643836 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dd8fba99-f10b-4244-867c-3bee02951b07 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:43.645219 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-dd8fba99-f10b-4244-867c-3bee02951b07 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:43.661080 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd8fba99-f10b-4244-867c-3bee02951b07 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:43.671816 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd8fba99-f10b-4244-867c-3bee02951b07 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:43.672460 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd8fba99-f10b-4244-867c-3bee02951b07 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:43.673498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd8fba99-f10b-4244-867c-3bee02951b07 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:43.674221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd8fba99-f10b-4244-867c-3bee02951b07 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:43.674878 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd8fba99-f10b-4244-867c-3bee02951b07 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:45.142491 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dd8fba99-f10b-4244-867c-3bee02951b07 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:45.162990 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dd8fba99-f10b-4244-867c-3bee02951b07 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1723 microversion: 2.1 time: 1.522171 Aug 30 01:18:45.163546 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 122/254] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:43 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1723 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:46.201204 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e34126ad-2300-479f-b8d5-be1809994dd8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:46.202047 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e34126ad-2300-479f-b8d5-be1809994dd8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:46.225398 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e34126ad-2300-479f-b8d5-be1809994dd8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:46.226127 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e34126ad-2300-479f-b8d5-be1809994dd8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:46.234196 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e34126ad-2300-479f-b8d5-be1809994dd8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:46.235352 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e34126ad-2300-479f-b8d5-be1809994dd8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:46.237709 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e34126ad-2300-479f-b8d5-be1809994dd8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:46.244970 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e34126ad-2300-479f-b8d5-be1809994dd8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:46.530806 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1021370906", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2938f22-9675-44ea-8234-907289538481"}], "security_groups": [{"name": "tempest-securitygroup--1158186747"}], "key_name": "tempest-keypair-1030540723", "user_data": "}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:46.971741 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e34126ad-2300-479f-b8d5-be1809994dd8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:46.981312 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e34126ad-2300-479f-b8d5-be1809994dd8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1723 microversion: 2.1 time: 0.785094 Aug 30 01:18:47.008038 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 133/255] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:46 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1723 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:47.180459 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] validate_networks() for [('b2938f22-9675-44ea-8234-907289538481', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:18:48.018603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3c6ccc0c-bd88-4af0-99e1-5d4cbc0abda2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:48.019736 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3c6ccc0c-bd88-4af0-99e1-5d4cbc0abda2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:48.041086 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c6ccc0c-bd88-4af0-99e1-5d4cbc0abda2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:48.044690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c6ccc0c-bd88-4af0-99e1-5d4cbc0abda2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:48.047521 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c6ccc0c-bd88-4af0-99e1-5d4cbc0abda2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:48.050951 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c6ccc0c-bd88-4af0-99e1-5d4cbc0abda2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:48.053424 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c6ccc0c-bd88-4af0-99e1-5d4cbc0abda2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:48.059184 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c6ccc0c-bd88-4af0-99e1-5d4cbc0abda2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:48.433073 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3c6ccc0c-bd88-4af0-99e1-5d4cbc0abda2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:48.460172 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3c6ccc0c-bd88-4af0-99e1-5d4cbc0abda2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1723 microversion: 2.1 time: 0.449017 Aug 30 01:18:48.462178 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 134/256] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:48 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1723 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:48.646499 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:18:48.647815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:18:48.648666 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:18:48.649258 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:18:48.649848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:18:48.669234 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:48.669810 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:48.671595 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:48.673536 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:48.676133 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:48.678577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:48.719477 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Getting quotas for project adf47975f465467498be24ebe2c81ad7. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:18:48.725849 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Getting quotas for user 6d5a0cf37e3b4d3084a178f83642c144 and project adf47975f465467498be24ebe2c81ad7. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:18:48.754872 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:18:48.757572 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:18:48.848121 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8a6b049e-5d2b-4cba-9405-68853455642f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.329900 Aug 30 01:18:48.851344 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 123/257] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:18:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 2334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:18:48.866715 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d78f24a6-8677-41a0-8abb-f13d7077652d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:48.867412 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d78f24a6-8677-41a0-8abb-f13d7077652d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:49.099398 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d78f24a6-8677-41a0-8abb-f13d7077652d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:49.111706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d78f24a6-8677-41a0-8abb-f13d7077652d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1246 microversion: 2.1 time: 0.247673 Aug 30 01:18:49.113943 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 135/258] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:48 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1246 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:49.502810 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1c0dfb13-9f4a-4016-91aa-2b00776f309f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:49.504033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1c0dfb13-9f4a-4016-91aa-2b00776f309f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:49.522424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1c0dfb13-9f4a-4016-91aa-2b00776f309f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:49.528083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1c0dfb13-9f4a-4016-91aa-2b00776f309f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:49.529702 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1c0dfb13-9f4a-4016-91aa-2b00776f309f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:49.530526 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1c0dfb13-9f4a-4016-91aa-2b00776f309f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:49.537998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1c0dfb13-9f4a-4016-91aa-2b00776f309f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:49.539780 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1c0dfb13-9f4a-4016-91aa-2b00776f309f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:50.027528 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1c0dfb13-9f4a-4016-91aa-2b00776f309f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:50.053924 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1c0dfb13-9f4a-4016-91aa-2b00776f309f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1723 microversion: 2.1 time: 0.556641 Aug 30 01:18:50.056600 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 124/259] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:49 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1723 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:50.162641 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f2160026-35eb-4556-a4ca-3565764dcc9c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:50.163961 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f2160026-35eb-4556-a4ca-3565764dcc9c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:50.177714 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2160026-35eb-4556-a4ca-3565764dcc9c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:50.178711 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2160026-35eb-4556-a4ca-3565764dcc9c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:50.182130 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2160026-35eb-4556-a4ca-3565764dcc9c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:50.184228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2160026-35eb-4556-a4ca-3565764dcc9c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:50.187702 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2160026-35eb-4556-a4ca-3565764dcc9c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:50.188615 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2160026-35eb-4556-a4ca-3565764dcc9c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:50.349325 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f2160026-35eb-4556-a4ca-3565764dcc9c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:50.358943 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f2160026-35eb-4556-a4ca-3565764dcc9c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1250 microversion: 2.1 time: 0.202691 Aug 30 01:18:50.361867 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 136/260] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:50 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1250 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:51.098870 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-63e2f75c-ea8c-437c-bd59-8ef1769c63ec tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:51.100435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-63e2f75c-ea8c-437c-bd59-8ef1769c63ec tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:51.121339 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-63e2f75c-ea8c-437c-bd59-8ef1769c63ec tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:51.122155 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-63e2f75c-ea8c-437c-bd59-8ef1769c63ec tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:51.122778 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-63e2f75c-ea8c-437c-bd59-8ef1769c63ec tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:51.123689 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-63e2f75c-ea8c-437c-bd59-8ef1769c63ec tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:51.124362 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-63e2f75c-ea8c-437c-bd59-8ef1769c63ec tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:51.124979 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-63e2f75c-ea8c-437c-bd59-8ef1769c63ec tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:51.410838 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-356047c2-be41-473a-8ac5-7a1c4290484a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:51.411624 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-356047c2-be41-473a-8ac5-7a1c4290484a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:51.443507 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-356047c2-be41-473a-8ac5-7a1c4290484a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:51.444390 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-356047c2-be41-473a-8ac5-7a1c4290484a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:51.445006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-356047c2-be41-473a-8ac5-7a1c4290484a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:51.446410 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-356047c2-be41-473a-8ac5-7a1c4290484a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:51.451132 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-356047c2-be41-473a-8ac5-7a1c4290484a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:51.451958 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-356047c2-be41-473a-8ac5-7a1c4290484a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:51.744332 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-63e2f75c-ea8c-437c-bd59-8ef1769c63ec tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:51.744631 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-356047c2-be41-473a-8ac5-7a1c4290484a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:51.761834 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-63e2f75c-ea8c-437c-bd59-8ef1769c63ec tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1723 microversion: 2.1 time: 0.667092 Aug 30 01:18:51.763286 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 125/261] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:51 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1723 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:51.765461 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-356047c2-be41-473a-8ac5-7a1c4290484a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1250 microversion: 2.1 time: 0.360483 Aug 30 01:18:51.780861 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 137/262] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:51 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1250 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:52.796697 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-da4b8b70-5cf1-4c52-b873-9e9a116e0001 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:52.799262 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-da4b8b70-5cf1-4c52-b873-9e9a116e0001 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:52.815137 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-16cf01b2-7266-4658-a04f-315250e59912 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:52.816232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-16cf01b2-7266-4658-a04f-315250e59912 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:52.827837 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da4b8b70-5cf1-4c52-b873-9e9a116e0001 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:52.828443 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da4b8b70-5cf1-4c52-b873-9e9a116e0001 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:52.830180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da4b8b70-5cf1-4c52-b873-9e9a116e0001 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:52.832577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da4b8b70-5cf1-4c52-b873-9e9a116e0001 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:52.834152 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da4b8b70-5cf1-4c52-b873-9e9a116e0001 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:52.836183 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da4b8b70-5cf1-4c52-b873-9e9a116e0001 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:52.868114 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-16cf01b2-7266-4658-a04f-315250e59912 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:52.868968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-16cf01b2-7266-4658-a04f-315250e59912 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:52.869669 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-16cf01b2-7266-4658-a04f-315250e59912 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:52.870811 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-16cf01b2-7266-4658-a04f-315250e59912 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:52.871525 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-16cf01b2-7266-4658-a04f-315250e59912 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:52.872338 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-16cf01b2-7266-4658-a04f-315250e59912 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:52.982688 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-da4b8b70-5cf1-4c52-b873-9e9a116e0001 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:52.995107 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-da4b8b70-5cf1-4c52-b873-9e9a116e0001 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1298 microversion: 2.1 time: 0.208894 Aug 30 01:18:53.008516 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 126/263] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:52 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1298 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:53.875853 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-16cf01b2-7266-4658-a04f-315250e59912 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:53.887258 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-16cf01b2-7266-4658-a04f-315250e59912 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1723 microversion: 2.1 time: 1.092216 Aug 30 01:18:53.888746 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 138/264] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:52 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1723 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:54.049781 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-82e8b6e7-d71d-47a2-9117-c3c74269c1c6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:54.051725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-82e8b6e7-d71d-47a2-9117-c3c74269c1c6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:54.080981 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82e8b6e7-d71d-47a2-9117-c3c74269c1c6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:54.081484 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82e8b6e7-d71d-47a2-9117-c3c74269c1c6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:54.081907 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82e8b6e7-d71d-47a2-9117-c3c74269c1c6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:54.082631 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82e8b6e7-d71d-47a2-9117-c3c74269c1c6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:54.083084 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82e8b6e7-d71d-47a2-9117-c3c74269c1c6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:54.083502 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82e8b6e7-d71d-47a2-9117-c3c74269c1c6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:54.320578 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-82e8b6e7-d71d-47a2-9117-c3c74269c1c6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:54.335642 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-82e8b6e7-d71d-47a2-9117-c3c74269c1c6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1304 microversion: 2.1 time: 0.297034 Aug 30 01:18:54.345051 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 127/265] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:54 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1304 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:54.917490 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4bde0db4-bbe4-4fa3-b780-cbff42646884 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:54.920919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4bde0db4-bbe4-4fa3-b780-cbff42646884 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:54.947061 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4bde0db4-bbe4-4fa3-b780-cbff42646884 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:54.950035 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4bde0db4-bbe4-4fa3-b780-cbff42646884 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:54.950794 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4bde0db4-bbe4-4fa3-b780-cbff42646884 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:54.951874 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4bde0db4-bbe4-4fa3-b780-cbff42646884 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:54.977914 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4bde0db4-bbe4-4fa3-b780-cbff42646884 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:54.981793 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4bde0db4-bbe4-4fa3-b780-cbff42646884 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:55.527612 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4bde0db4-bbe4-4fa3-b780-cbff42646884 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:55.545167 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4bde0db4-bbe4-4fa3-b780-cbff42646884 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1723 microversion: 2.1 time: 0.635746 Aug 30 01:18:55.545765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 139/266] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:54 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1723 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:55.564665 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8d2110c1-cc70-46db-8772-a93c1f409c7b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:55.565451 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8d2110c1-cc70-46db-8772-a93c1f409c7b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:55.586386 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d2110c1-cc70-46db-8772-a93c1f409c7b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:55.586888 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d2110c1-cc70-46db-8772-a93c1f409c7b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:55.592495 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d2110c1-cc70-46db-8772-a93c1f409c7b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:55.594405 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d2110c1-cc70-46db-8772-a93c1f409c7b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:55.596082 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d2110c1-cc70-46db-8772-a93c1f409c7b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:55.598213 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d2110c1-cc70-46db-8772-a93c1f409c7b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:55.659915 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ee50c9fb-c2a3-4fda-bb0f-6018bd8fd9a6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Action: 'create', calling method: .version_select at 0x7ff48afad550>, body: {"keypair": {"name": "tempest-TestShelveInstance-482259432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKniK3W6moJsgju4UOJ92Wh454UPfMn2S+IAwrAGL2VsyJWJAztL1m2JC8XEwnXvo1Mj+HBIpns9BWr4XFrHBcjldptCUujsg1noy8nCr1bZUZdg1y1yYKY53+1nK4mIWw=="}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:55.730267 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-ee50c9fb-c2a3-4fda-bb0f-6018bd8fd9a6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Getting quotas for project 089c19009d374769a0d5bd5a82acaaa7. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:18:55.738156 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-ee50c9fb-c2a3-4fda-bb0f-6018bd8fd9a6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Getting quotas for user e76eba6f76f84c5cb006e079aa86157a and project 089c19009d374769a0d5bd5a82acaaa7. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:18:55.801253 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ee50c9fb-c2a3-4fda-bb0f-6018bd8fd9a6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.841167 Aug 30 01:18:55.802229 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 128/267] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Aug 30 01:18:54 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:18:56.170791 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8d2110c1-cc70-46db-8772-a93c1f409c7b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:56.194740 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8d2110c1-cc70-46db-8772-a93c1f409c7b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1372 microversion: 2.1 time: 0.642500 Aug 30 01:18:56.198267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 140/268] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:55 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1372 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:56.571616 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6af54ec3-11c2-44d9-a20e-c59df3f49856 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:56.572283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6af54ec3-11c2-44d9-a20e-c59df3f49856 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:56.603632 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6af54ec3-11c2-44d9-a20e-c59df3f49856 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:56.604964 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6af54ec3-11c2-44d9-a20e-c59df3f49856 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:56.611653 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6af54ec3-11c2-44d9-a20e-c59df3f49856 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:56.614605 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6af54ec3-11c2-44d9-a20e-c59df3f49856 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:56.617278 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6af54ec3-11c2-44d9-a20e-c59df3f49856 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:56.618170 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6af54ec3-11c2-44d9-a20e-c59df3f49856 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:57.207980 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6af54ec3-11c2-44d9-a20e-c59df3f49856 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:57.229404 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7eb7cb89-15ea-4d96-846d-691839be5d25 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:57.230016 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7eb7cb89-15ea-4d96-846d-691839be5d25 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:57.243409 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7eb7cb89-15ea-4d96-846d-691839be5d25 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:57.243409 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7eb7cb89-15ea-4d96-846d-691839be5d25 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:57.243409 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7eb7cb89-15ea-4d96-846d-691839be5d25 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:57.252158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7eb7cb89-15ea-4d96-846d-691839be5d25 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:57.252658 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7eb7cb89-15ea-4d96-846d-691839be5d25 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:57.253096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7eb7cb89-15ea-4d96-846d-691839be5d25 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:57.276348 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6af54ec3-11c2-44d9-a20e-c59df3f49856 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1700 microversion: 2.1 time: 0.709957 Aug 30 01:18:57.280733 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 129/269] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:56 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1700 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:57.308223 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4482deff-af09-43af-9075-acc037824ea8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:57.315607 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4482deff-af09-43af-9075-acc037824ea8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:57.319303 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4482deff-af09-43af-9075-acc037824ea8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:57.320574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4482deff-af09-43af-9075-acc037824ea8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:57.377629 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4482deff-af09-43af-9075-acc037824ea8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Going to try to start instance {{(pid=120706) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 01:18:57.475724 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4482deff-af09-43af-9075-acc037824ea8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "POST /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/action" status: 202 len: 0 microversion: 2.1 time: 0.171231 Aug 30 01:18:57.477366 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 130/270] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:18:57 2022] POST /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:18:57.497035 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-60c654ab-0cbc-4af6-bd68-43762b899abe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:57.500172 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-60c654ab-0cbc-4af6-bd68-43762b899abe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:57.518854 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60c654ab-0cbc-4af6-bd68-43762b899abe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:57.520858 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60c654ab-0cbc-4af6-bd68-43762b899abe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:57.522785 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60c654ab-0cbc-4af6-bd68-43762b899abe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:57.525502 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60c654ab-0cbc-4af6-bd68-43762b899abe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:57.527108 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60c654ab-0cbc-4af6-bd68-43762b899abe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:57.528847 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60c654ab-0cbc-4af6-bd68-43762b899abe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:58.686125 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7eb7cb89-15ea-4d96-846d-691839be5d25 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:58.696188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:58.709501 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7eb7cb89-15ea-4d96-846d-691839be5d25 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1372 microversion: 2.1 time: 1.488870 Aug 30 01:18:58.727915 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 141/271] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:57 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1372 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:58.735550 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-f74cab16-6398-40f7-b012-33b9e45d9eb9 req-47edde90-169e-4d07-b047-44a2d0106a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6ce1c9-bac7-4653-8051-123c152ed7df", "tag": "4c098562-e7ad-4247-be8d-fe3c6317e383"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:58.750980 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-f74cab16-6398-40f7-b012-33b9e45d9eb9 req-47edde90-169e-4d07-b047-44a2d0106a12 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:58.752133 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-f74cab16-6398-40f7-b012-33b9e45d9eb9 req-47edde90-169e-4d07-b047-44a2d0106a12 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:58.753433 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-f74cab16-6398-40f7-b012-33b9e45d9eb9 req-47edde90-169e-4d07-b047-44a2d0106a12 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:58.926132 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-60c654ab-0cbc-4af6-bd68-43762b899abe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:58.936339 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-60c654ab-0cbc-4af6-bd68-43762b899abe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1709 microversion: 2.1 time: 1.453019 Aug 30 01:18:58.968367 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 131/272] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:57 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1709 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:58.973472 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-577cb423-6650-4978-8b31-2b954a951d02 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "889d5104-b5a8-474c-bc7a-49c0f0be10cb", "device": "/dev/sdb"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:58.997883 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-577cb423-6650-4978-8b31-2b954a951d02 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:59.029671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-577cb423-6650-4978-8b31-2b954a951d02 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:59.032538 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-577cb423-6650-4978-8b31-2b954a951d02 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:59.033048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-577cb423-6650-4978-8b31-2b954a951d02 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:59.037779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-577cb423-6650-4978-8b31-2b954a951d02 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:59.038661 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-577cb423-6650-4978-8b31-2b954a951d02 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:59.042223 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-577cb423-6650-4978-8b31-2b954a951d02 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:59.154735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:59.163263 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-f74cab16-6398-40f7-b012-33b9e45d9eb9 req-47edde90-169e-4d07-b047-44a2d0106a12 service nova] Creating event network-changed:4c098562-e7ad-4247-be8d-fe3c6317e383 for instance 9f6ce1c9-bac7-4653-8051-123c152ed7df on hv-cinder-81514 Aug 30 01:18:59.189408 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-f74cab16-6398-40f7-b012-33b9e45d9eb9 req-47edde90-169e-4d07-b047-44a2d0106a12 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.451565 Aug 30 01:18:59.190511 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 142/273] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:59.736704 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d94434a8-9b28-4dea-b381-902d24b958e0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:59.738174 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d94434a8-9b28-4dea-b381-902d24b958e0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:59.777002 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d94434a8-9b28-4dea-b381-902d24b958e0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:59.781370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d94434a8-9b28-4dea-b381-902d24b958e0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:59.788075 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d94434a8-9b28-4dea-b381-902d24b958e0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:59.789007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d94434a8-9b28-4dea-b381-902d24b958e0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:59.789673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d94434a8-9b28-4dea-b381-902d24b958e0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:59.792391 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d94434a8-9b28-4dea-b381-902d24b958e0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:00.057513 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-577cb423-6650-4978-8b31-2b954a951d02 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "POST /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.087737 Aug 30 01:19:00.060528 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 132/274] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:18:58 2022] POST /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f/os-volume_attachments => generated 194 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:19:00.097524 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dd8244a9-e4a8-42a7-b965-60d23794c815 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:00.101857 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-dd8244a9-e4a8-42a7-b965-60d23794c815 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:00.140612 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd8244a9-e4a8-42a7-b965-60d23794c815 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:00.146255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd8244a9-e4a8-42a7-b965-60d23794c815 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:00.146937 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd8244a9-e4a8-42a7-b965-60d23794c815 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:00.149224 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd8244a9-e4a8-42a7-b965-60d23794c815 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:00.149813 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd8244a9-e4a8-42a7-b965-60d23794c815 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:00.154901 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd8244a9-e4a8-42a7-b965-60d23794c815 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:00.596042 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dd8244a9-e4a8-42a7-b965-60d23794c815 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:00.609108 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dd8244a9-e4a8-42a7-b965-60d23794c815 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1709 microversion: 2.1 time: 0.545103 Aug 30 01:19:00.610643 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 133/275] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:00 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1709 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:00.723562 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d94434a8-9b28-4dea-b381-902d24b958e0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:00.759446 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d94434a8-9b28-4dea-b381-902d24b958e0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1372 microversion: 2.1 time: 1.030232 Aug 30 01:19:00.760616 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 143/276] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:59 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1372 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:01.639344 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8079be59-45f4-442b-8aa9-2cab652e942a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:01.640453 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8079be59-45f4-442b-8aa9-2cab652e942a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:01.677038 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8079be59-45f4-442b-8aa9-2cab652e942a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:01.698999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8079be59-45f4-442b-8aa9-2cab652e942a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:01.701028 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8079be59-45f4-442b-8aa9-2cab652e942a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:01.703543 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8079be59-45f4-442b-8aa9-2cab652e942a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:01.705492 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8079be59-45f4-442b-8aa9-2cab652e942a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:01.709954 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8079be59-45f4-442b-8aa9-2cab652e942a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:01.758690 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:01.816878 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-06d9c932-67ef-4754-b88b-d4bee16a8c33 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:01.828591 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-06d9c932-67ef-4754-b88b-d4bee16a8c33 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:01.878834 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06d9c932-67ef-4754-b88b-d4bee16a8c33 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:01.880098 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06d9c932-67ef-4754-b88b-d4bee16a8c33 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:01.881136 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06d9c932-67ef-4754-b88b-d4bee16a8c33 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:01.882706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06d9c932-67ef-4754-b88b-d4bee16a8c33 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:01.884310 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06d9c932-67ef-4754-b88b-d4bee16a8c33 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:01.885381 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06d9c932-67ef-4754-b88b-d4bee16a8c33 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:02.348186 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8079be59-45f4-442b-8aa9-2cab652e942a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:02.369621 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8079be59-45f4-442b-8aa9-2cab652e942a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1709 microversion: 2.1 time: 0.741410 Aug 30 01:19:02.378369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 134/277] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:01 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1709 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:02.619839 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-06d9c932-67ef-4754-b88b-d4bee16a8c33 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:02.644630 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-06d9c932-67ef-4754-b88b-d4bee16a8c33 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1372 microversion: 2.1 time: 0.862935 Aug 30 01:19:02.645226 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 144/278] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:01 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1372 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:03.413442 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-aa0f5459-6522-4727-b76e-1836cbc8a8a2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:03.414124 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-aa0f5459-6522-4727-b76e-1836cbc8a8a2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:03.416923 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=5 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:03.435697 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aa0f5459-6522-4727-b76e-1836cbc8a8a2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:03.438894 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aa0f5459-6522-4727-b76e-1836cbc8a8a2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:03.440379 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aa0f5459-6522-4727-b76e-1836cbc8a8a2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:03.443917 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aa0f5459-6522-4727-b76e-1836cbc8a8a2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:03.444749 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aa0f5459-6522-4727-b76e-1836cbc8a8a2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:03.445407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aa0f5459-6522-4727-b76e-1836cbc8a8a2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:03.666549 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fbb2f1b1-b9d1-4c00-ba1a-6989f8cb872d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:03.667210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fbb2f1b1-b9d1-4c00-ba1a-6989f8cb872d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:03.675017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=38 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:03.681619 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbb2f1b1-b9d1-4c00-ba1a-6989f8cb872d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:03.682475 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbb2f1b1-b9d1-4c00-ba1a-6989f8cb872d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:03.683094 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbb2f1b1-b9d1-4c00-ba1a-6989f8cb872d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:03.685008 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbb2f1b1-b9d1-4c00-ba1a-6989f8cb872d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:03.685697 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbb2f1b1-b9d1-4c00-ba1a-6989f8cb872d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:03.691618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbb2f1b1-b9d1-4c00-ba1a-6989f8cb872d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:04.080959 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-aa0f5459-6522-4727-b76e-1836cbc8a8a2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:04.092477 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-aa0f5459-6522-4727-b76e-1836cbc8a8a2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1713 microversion: 2.1 time: 0.684250 Aug 30 01:19:04.113192 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 135/279] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:03 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1713 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:04.162791 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fbb2f1b1-b9d1-4c00-ba1a-6989f8cb872d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:04.181185 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fbb2f1b1-b9d1-4c00-ba1a-6989f8cb872d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1372 microversion: 2.1 time: 0.510500 Aug 30 01:19:04.183232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 145/280] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:03 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1372 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:19:05.210638 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ae2c607a-2ef3-4535-8265-133bc29c3d63 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:05.211505 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ae2c607a-2ef3-4535-8265-133bc29c3d63 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:05.223725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ae2c607a-2ef3-4535-8265-133bc29c3d63 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:05.224245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ae2c607a-2ef3-4535-8265-133bc29c3d63 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:05.236921 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ae2c607a-2ef3-4535-8265-133bc29c3d63 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:05.237995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ae2c607a-2ef3-4535-8265-133bc29c3d63 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:05.238474 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ae2c607a-2ef3-4535-8265-133bc29c3d63 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:05.238898 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ae2c607a-2ef3-4535-8265-133bc29c3d63 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:05.625596 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ae2c607a-2ef3-4535-8265-133bc29c3d63 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:05.654116 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ae2c607a-2ef3-4535-8265-133bc29c3d63 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1372 microversion: 2.1 time: 0.452134 Aug 30 01:19:05.654719 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 136/281] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:05 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1372 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:19:06.689685 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-099b69f3-258e-46ac-a955-d601d245f4e5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:06.690293 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-099b69f3-258e-46ac-a955-d601d245f4e5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:06.706037 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-099b69f3-258e-46ac-a955-d601d245f4e5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:06.706627 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-099b69f3-258e-46ac-a955-d601d245f4e5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:06.711048 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-099b69f3-258e-46ac-a955-d601d245f4e5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:06.712902 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-099b69f3-258e-46ac-a955-d601d245f4e5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:06.715987 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-099b69f3-258e-46ac-a955-d601d245f4e5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:06.716768 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-099b69f3-258e-46ac-a955-d601d245f4e5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:06.765639 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=99 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:06.982576 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-099b69f3-258e-46ac-a955-d601d245f4e5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:06.992449 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-099b69f3-258e-46ac-a955-d601d245f4e5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1372 microversion: 2.1 time: 0.306710 Aug 30 01:19:06.993294 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 146/282] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:06 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1372 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:07.950222 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-c8771339-aa5c-4bac-a168-49515d45089c req-eb19b0fc-11da-4dbd-b6a2-5cca47194386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6ce1c9-bac7-4653-8051-123c152ed7df", "name": "network-vif-plugged", "status": "completed", "tag": "4c098562-e7ad-4247-be8d-fe3c6317e383"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:19:07.962265 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=14 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:07.966979 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-c8771339-aa5c-4bac-a168-49515d45089c req-eb19b0fc-11da-4dbd-b6a2-5cca47194386 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:07.968989 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-c8771339-aa5c-4bac-a168-49515d45089c req-eb19b0fc-11da-4dbd-b6a2-5cca47194386 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:07.969683 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-c8771339-aa5c-4bac-a168-49515d45089c req-eb19b0fc-11da-4dbd-b6a2-5cca47194386 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:08.023170 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d7991b4a-2ae1-4659-90e1-2d3bac4a85e3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:08.026249 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d7991b4a-2ae1-4659-90e1-2d3bac4a85e3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:08.055116 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d7991b4a-2ae1-4659-90e1-2d3bac4a85e3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:08.055804 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-c8771339-aa5c-4bac-a168-49515d45089c req-eb19b0fc-11da-4dbd-b6a2-5cca47194386 service nova] Creating event network-vif-plugged:4c098562-e7ad-4247-be8d-fe3c6317e383 for instance 9f6ce1c9-bac7-4653-8051-123c152ed7df on hv-cinder-81514 Aug 30 01:19:08.060424 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d7991b4a-2ae1-4659-90e1-2d3bac4a85e3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:08.062253 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d7991b4a-2ae1-4659-90e1-2d3bac4a85e3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:08.064359 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d7991b4a-2ae1-4659-90e1-2d3bac4a85e3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:08.076558 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d7991b4a-2ae1-4659-90e1-2d3bac4a85e3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:08.077439 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d7991b4a-2ae1-4659-90e1-2d3bac4a85e3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:08.080679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-c8771339-aa5c-4bac-a168-49515d45089c req-eb19b0fc-11da-4dbd-b6a2-5cca47194386 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131764 Aug 30 01:19:08.083235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 137/283] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:19:08.336706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d7991b4a-2ae1-4659-90e1-2d3bac4a85e3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:08.347583 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d7991b4a-2ae1-4659-90e1-2d3bac4a85e3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1372 microversion: 2.1 time: 0.336047 Aug 30 01:19:08.351410 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 147/284] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:08 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1372 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:09.379145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dc95ba95-e1a2-49a2-9a46-0a43266698f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:09.380651 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-dc95ba95-e1a2-49a2-9a46-0a43266698f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:09.402893 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dc95ba95-e1a2-49a2-9a46-0a43266698f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:09.403841 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dc95ba95-e1a2-49a2-9a46-0a43266698f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:09.404343 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dc95ba95-e1a2-49a2-9a46-0a43266698f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:09.405297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dc95ba95-e1a2-49a2-9a46-0a43266698f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:09.406579 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dc95ba95-e1a2-49a2-9a46-0a43266698f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:09.409174 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dc95ba95-e1a2-49a2-9a46-0a43266698f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:09.950301 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dc95ba95-e1a2-49a2-9a46-0a43266698f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:09.963512 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dc95ba95-e1a2-49a2-9a46-0a43266698f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1372 microversion: 2.1 time: 0.592077 Aug 30 01:19:09.981668 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 138/285] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:09 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1372 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:11.005468 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a20614be-b381-4948-bb5d-b2119d17e462 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:11.006753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a20614be-b381-4948-bb5d-b2119d17e462 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:11.014840 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a20614be-b381-4948-bb5d-b2119d17e462 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:11.015730 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a20614be-b381-4948-bb5d-b2119d17e462 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:11.016607 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a20614be-b381-4948-bb5d-b2119d17e462 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:11.017581 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a20614be-b381-4948-bb5d-b2119d17e462 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:11.018230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a20614be-b381-4948-bb5d-b2119d17e462 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:11.018857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a20614be-b381-4948-bb5d-b2119d17e462 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:11.185237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a20614be-b381-4948-bb5d-b2119d17e462 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:11.193051 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a20614be-b381-4948-bb5d-b2119d17e462 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1372 microversion: 2.1 time: 0.192005 Aug 30 01:19:11.193621 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 148/286] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:10 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:12.218979 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a692d919-a8ea-45e9-9b09-662d680b4b77 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:12.219593 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a692d919-a8ea-45e9-9b09-662d680b4b77 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:12.232232 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a692d919-a8ea-45e9-9b09-662d680b4b77 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:12.236123 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a692d919-a8ea-45e9-9b09-662d680b4b77 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:12.241758 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a692d919-a8ea-45e9-9b09-662d680b4b77 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:12.242524 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a692d919-a8ea-45e9-9b09-662d680b4b77 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:12.243001 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a692d919-a8ea-45e9-9b09-662d680b4b77 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:12.243431 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a692d919-a8ea-45e9-9b09-662d680b4b77 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:12.469149 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a692d919-a8ea-45e9-9b09-662d680b4b77 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:12.483865 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a692d919-a8ea-45e9-9b09-662d680b4b77 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1372 microversion: 2.1 time: 0.272252 Aug 30 01:19:12.485132 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 139/287] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:12 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1372 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:13.509617 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7a4f56ef-5a12-414e-9717-5f7530c2ce1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:13.510236 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7a4f56ef-5a12-414e-9717-5f7530c2ce1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:13.517532 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a4f56ef-5a12-414e-9717-5f7530c2ce1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:13.518251 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a4f56ef-5a12-414e-9717-5f7530c2ce1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:13.518690 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a4f56ef-5a12-414e-9717-5f7530c2ce1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:13.519424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a4f56ef-5a12-414e-9717-5f7530c2ce1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:13.520068 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a4f56ef-5a12-414e-9717-5f7530c2ce1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:13.520491 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a4f56ef-5a12-414e-9717-5f7530c2ce1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:13.701565 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7a4f56ef-5a12-414e-9717-5f7530c2ce1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:13.711162 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7a4f56ef-5a12-414e-9717-5f7530c2ce1e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1372 microversion: 2.1 time: 0.206219 Aug 30 01:19:13.729652 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 140/288] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:13 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:13.825934 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-78b5765e-e0e6-4ba1-b15b-8b55f6109bc9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Action: 'create', calling method: .version_select at 0x7ff48c399040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-799326755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFI1fkS1C7zwdC+6uyPXJ4711XUs3AhEd1HIfIXLGWsCKljVAanM7sks06VvC84mS+bpkLm2aYx3JfgE3HziF675WSvrawJV+2vDGo0KQL99JKg3uD3WPs5v68zC7yFEw=="}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:19:13.843261 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-78b5765e-e0e6-4ba1-b15b-8b55f6109bc9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Getting quotas for project 20cdcff29a0448dc92460b2ddd45617b. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:19:13.848014 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-78b5765e-e0e6-4ba1-b15b-8b55f6109bc9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Getting quotas for user 2839103f52324a1ab1ebd43fe230addc and project 20cdcff29a0448dc92460b2ddd45617b. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:19:13.890937 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-78b5765e-e0e6-4ba1-b15b-8b55f6109bc9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.395025 Aug 30 01:19:13.900782 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 149/289] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Aug 30 01:19:13 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:19:14.738591 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a2fbd998-1bf0-46d0-859c-dc9aaa8dad47 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:14.739228 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a2fbd998-1bf0-46d0-859c-dc9aaa8dad47 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:14.748121 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2fbd998-1bf0-46d0-859c-dc9aaa8dad47 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:14.748624 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2fbd998-1bf0-46d0-859c-dc9aaa8dad47 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:14.749063 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2fbd998-1bf0-46d0-859c-dc9aaa8dad47 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:14.749820 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2fbd998-1bf0-46d0-859c-dc9aaa8dad47 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:14.750278 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2fbd998-1bf0-46d0-859c-dc9aaa8dad47 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:14.750797 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2fbd998-1bf0-46d0-859c-dc9aaa8dad47 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:14.956854 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a2fbd998-1bf0-46d0-859c-dc9aaa8dad47 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:14.971401 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a2fbd998-1bf0-46d0-859c-dc9aaa8dad47 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1566 microversion: 2.1 time: 0.240486 Aug 30 01:19:14.988480 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 141/290] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:14 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1566 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:14.999640 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7b8abcd9-e821-4a5e-a4ce-048d527f5a24 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:15.000116 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7b8abcd9-e821-4a5e-a4ce-048d527f5a24 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:15.009603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7b8abcd9-e821-4a5e-a4ce-048d527f5a24 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:15.010094 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7b8abcd9-e821-4a5e-a4ce-048d527f5a24 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:15.010846 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7b8abcd9-e821-4a5e-a4ce-048d527f5a24 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:15.011597 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7b8abcd9-e821-4a5e-a4ce-048d527f5a24 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:15.012076 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7b8abcd9-e821-4a5e-a4ce-048d527f5a24 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:15.012651 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7b8abcd9-e821-4a5e-a4ce-048d527f5a24 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:15.131151 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7b8abcd9-e821-4a5e-a4ce-048d527f5a24 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137585 Aug 30 01:19:15.132975 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 150/291] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Aug 30 01:19:14 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:19:16.456891 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-3f37dc4d-d94f-40cb-a841-b7ddc5166a24 req-c7fb91e9-bfdc-4cc2-9a6a-ec44186eee98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6ce1c9-bac7-4653-8051-123c152ed7df", "tag": "4c098562-e7ad-4247-be8d-fe3c6317e383"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:19:16.472699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3f37dc4d-d94f-40cb-a841-b7ddc5166a24 req-c7fb91e9-bfdc-4cc2-9a6a-ec44186eee98 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:16.473183 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3f37dc4d-d94f-40cb-a841-b7ddc5166a24 req-c7fb91e9-bfdc-4cc2-9a6a-ec44186eee98 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:16.473612 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3f37dc4d-d94f-40cb-a841-b7ddc5166a24 req-c7fb91e9-bfdc-4cc2-9a6a-ec44186eee98 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:16.486061 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-3f37dc4d-d94f-40cb-a841-b7ddc5166a24 req-c7fb91e9-bfdc-4cc2-9a6a-ec44186eee98 service nova] Creating event network-changed:4c098562-e7ad-4247-be8d-fe3c6317e383 for instance 9f6ce1c9-bac7-4653-8051-123c152ed7df on hv-cinder-81514 Aug 30 01:19:16.492769 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-3f37dc4d-d94f-40cb-a841-b7ddc5166a24 req-c7fb91e9-bfdc-4cc2-9a6a-ec44186eee98 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040504 Aug 30 01:19:16.493935 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 142/292] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:19:29.713695 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=4 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:29.714450 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:29.715068 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=21 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:29.719754 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7a3b08e0-f7d1-46b8-8a18-37e8f7d6efc8 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:29.720497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7a3b08e0-f7d1-46b8-8a18-37e8f7d6efc8 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:29.728726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a3b08e0-f7d1-46b8-8a18-37e8f7d6efc8 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:29.729223 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a3b08e0-f7d1-46b8-8a18-37e8f7d6efc8 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:29.729681 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a3b08e0-f7d1-46b8-8a18-37e8f7d6efc8 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:29.730448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a3b08e0-f7d1-46b8-8a18-37e8f7d6efc8 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:29.730898 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a3b08e0-f7d1-46b8-8a18-37e8f7d6efc8 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:29.731317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a3b08e0-f7d1-46b8-8a18-37e8f7d6efc8 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:29.927248 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-7a3b08e0-f7d1-46b8-8a18-37e8f7d6efc8 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lazy-loading 'services' on Instance uuid 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:19:30.089851 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7a3b08e0-f7d1-46b8-8a18-37e8f7d6efc8 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "DELETE /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f/os-volume_attachments/889d5104-b5a8-474c-bc7a-49c0f0be10cb" status: 202 len: 0 microversion: 2.1 time: 0.376710 Aug 30 01:19:30.090452 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 151/293] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Aug 30 01:19:29 2022] DELETE /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f/os-volume_attachments/889d5104-b5a8-474c-bc7a-49c0f0be10cb => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:19:32.340684 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=15 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:32.341632 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=43 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:32.346565 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a12fa3ed-2ec7-446c-9e31-220072b88d9c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:32.346904 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a12fa3ed-2ec7-446c-9e31-220072b88d9c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:32.355619 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a12fa3ed-2ec7-446c-9e31-220072b88d9c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:32.356151 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a12fa3ed-2ec7-446c-9e31-220072b88d9c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:32.356624 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a12fa3ed-2ec7-446c-9e31-220072b88d9c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:32.357334 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a12fa3ed-2ec7-446c-9e31-220072b88d9c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:32.357895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a12fa3ed-2ec7-446c-9e31-220072b88d9c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:32.358461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a12fa3ed-2ec7-446c-9e31-220072b88d9c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:32.388769 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a12fa3ed-2ec7-446c-9e31-220072b88d9c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:19:32.473952 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a12fa3ed-2ec7-446c-9e31-220072b88d9c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "DELETE /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 204 len: 0 microversion: 2.1 time: 0.134641 Aug 30 01:19:32.474544 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 143/294] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:19:32 2022] DELETE /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:19:32.484579 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ea123e31-5960-4bfd-9597-92ff7cf2a9e6 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:32.485282 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ea123e31-5960-4bfd-9597-92ff7cf2a9e6 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:32.491585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea123e31-5960-4bfd-9597-92ff7cf2a9e6 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:32.492118 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea123e31-5960-4bfd-9597-92ff7cf2a9e6 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:32.492552 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea123e31-5960-4bfd-9597-92ff7cf2a9e6 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:32.493450 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea123e31-5960-4bfd-9597-92ff7cf2a9e6 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:32.493901 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea123e31-5960-4bfd-9597-92ff7cf2a9e6 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:32.494322 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea123e31-5960-4bfd-9597-92ff7cf2a9e6 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:32.645429 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ea123e31-5960-4bfd-9597-92ff7cf2a9e6 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:32.653931 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ea123e31-5960-4bfd-9597-92ff7cf2a9e6 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1514 microversion: 2.1 time: 0.174095 Aug 30 01:19:32.654515 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 152/295] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:32 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:33.677385 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c30f87dc-db5c-4da6-a195-ef143c793acf tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:33.678025 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c30f87dc-db5c-4da6-a195-ef143c793acf tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:33.686125 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c30f87dc-db5c-4da6-a195-ef143c793acf tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:33.686615 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c30f87dc-db5c-4da6-a195-ef143c793acf tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:33.687054 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c30f87dc-db5c-4da6-a195-ef143c793acf tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:33.687761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c30f87dc-db5c-4da6-a195-ef143c793acf tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:33.688243 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c30f87dc-db5c-4da6-a195-ef143c793acf tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:33.688664 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c30f87dc-db5c-4da6-a195-ef143c793acf tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:33.844107 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c30f87dc-db5c-4da6-a195-ef143c793acf tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:33.853183 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c30f87dc-db5c-4da6-a195-ef143c793acf tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1514 microversion: 2.1 time: 0.179590 Aug 30 01:19:33.854088 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 144/296] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:33 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:34.881464 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-76dde33e-9cf4-439e-bfe3-2a890a6525f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:34.881464 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-76dde33e-9cf4-439e-bfe3-2a890a6525f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:34.884572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76dde33e-9cf4-439e-bfe3-2a890a6525f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:34.884572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76dde33e-9cf4-439e-bfe3-2a890a6525f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:34.884985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76dde33e-9cf4-439e-bfe3-2a890a6525f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:34.886482 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76dde33e-9cf4-439e-bfe3-2a890a6525f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:34.887435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76dde33e-9cf4-439e-bfe3-2a890a6525f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:34.888680 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76dde33e-9cf4-439e-bfe3-2a890a6525f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:35.067118 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-76dde33e-9cf4-439e-bfe3-2a890a6525f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:35.077788 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-76dde33e-9cf4-439e-bfe3-2a890a6525f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1514 microversion: 2.1 time: 0.205874 Aug 30 01:19:35.078396 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 153/297] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:34 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:19:36.103957 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c11589c5-1284-46e4-9d34-96e3a772bbac tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:36.104794 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c11589c5-1284-46e4-9d34-96e3a772bbac tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:36.111908 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c11589c5-1284-46e4-9d34-96e3a772bbac tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:36.112438 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c11589c5-1284-46e4-9d34-96e3a772bbac tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:36.112876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c11589c5-1284-46e4-9d34-96e3a772bbac tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:36.113766 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c11589c5-1284-46e4-9d34-96e3a772bbac tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:36.114230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c11589c5-1284-46e4-9d34-96e3a772bbac tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:36.114644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c11589c5-1284-46e4-9d34-96e3a772bbac tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:36.229931 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c11589c5-1284-46e4-9d34-96e3a772bbac tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:36.246391 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-b0eff105-9292-457e-b0d7-09f246e8953f req-4ed4f438-c03f-4876-860c-46941884beed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89032f52-7c5b-4ce4-bbb5-9358b2c1f80f", "name": "network-vif-deleted", "tag": "83d95f9d-945b-4916-bdf9-c95d4a1fd537"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:19:36.250420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c11589c5-1284-46e4-9d34-96e3a772bbac tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1472 microversion: 2.1 time: 0.152316 Aug 30 01:19:36.268036 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 145/298] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:36 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1472 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:36.300449 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b0eff105-9292-457e-b0d7-09f246e8953f req-4ed4f438-c03f-4876-860c-46941884beed service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:36.301001 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b0eff105-9292-457e-b0d7-09f246e8953f req-4ed4f438-c03f-4876-860c-46941884beed service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:36.301685 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b0eff105-9292-457e-b0d7-09f246e8953f req-4ed4f438-c03f-4876-860c-46941884beed service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:36.328437 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-b0eff105-9292-457e-b0d7-09f246e8953f req-4ed4f438-c03f-4876-860c-46941884beed service nova] Creating event network-vif-deleted:83d95f9d-945b-4916-bdf9-c95d4a1fd537 for instance 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f on hv-cinder-81514 Aug 30 01:19:36.336801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-b0eff105-9292-457e-b0d7-09f246e8953f req-4ed4f438-c03f-4876-860c-46941884beed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097958 Aug 30 01:19:36.338418 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 154/299] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:19:37.299805 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:37.300851 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:37.307623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:37.308156 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:37.308584 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:37.309523 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:37.310520 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:37.310961 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:37.366744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:37.367883 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:37.368520 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:37.369350 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lazy-loading 'fault' on Instance uuid 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:19:37.425451 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:37.439474 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f68150d9-67bc-497d-bb3e-1318b97c423f tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 200 len: 1309 microversion: 2.1 time: 0.143550 Aug 30 01:19:37.449010 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 146/300] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:37 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 1309 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:38.465194 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-85eee3ac-8db0-4d8b-988d-991341395c82 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:38.466746 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-85eee3ac-8db0-4d8b-988d-991341395c82 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:38.475356 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85eee3ac-8db0-4d8b-988d-991341395c82 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:38.475848 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85eee3ac-8db0-4d8b-988d-991341395c82 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:38.476528 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85eee3ac-8db0-4d8b-988d-991341395c82 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:38.477759 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85eee3ac-8db0-4d8b-988d-991341395c82 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:38.478408 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85eee3ac-8db0-4d8b-988d-991341395c82 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:38.479051 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85eee3ac-8db0-4d8b-988d-991341395c82 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:38.496370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-85eee3ac-8db0-4d8b-988d-991341395c82 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] HTTP exception thrown: Instance 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f could not be found. Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-85eee3ac-8db0-4d8b-988d-991341395c82 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Request method failure captured: Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f HTTP/1.1 Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWVVB0TM4bljELh5Tu9c2gY-My6g1f766aUo2FOqi54vgVHENRbw9CuP1uLiwZmgDr9zC2ks6Do19RCNCIKyR7-2Bf1D1ine4WdhRiFW-M9KLcVHks7lsQ_4x1ZMLDuPO2hzwkWCBLIlcU255pd2L1MyHgz7hTjZPu_13Gg8XwUWpEs Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: 2815adc7e64040c8986b1bd3f4519343 Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1762091566 Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:19:38.498055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:19:38.500158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2815adc7e64040c8986b1bd3f4519343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2815adc7e64040c8986b1bd3f4519343"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2815adc7e64040c8986b1bd3f4519343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2815adc7e64040c8986b1bd3f4519343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:19:38.500158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-VolumesSnapshotTestJSON-1762091566 Aug 30 01:19:38.500158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 2815adc7e64040c8986b1bd3f4519343 Aug 30 01:19:38.500158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1762091566 Aug 30 01:19:38.500158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-VolumesSnapshotTestJSON-1762091566-project Aug 30 01:19:38.500158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:19:38.500158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:19:38.500158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 64b579837fb4434282224eb7b83e57ab Aug 30 01:19:38.500158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-VolumesSnapshotTestJSON-1762091566-project Aug 30 01:19:38.500158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:19:38.500158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f could not be found. Aug 30 01:19:38.500158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '89032f52-7c5b-4ce4-bbb5-9358b2c1f80f'} Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f could not be found. Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:19:38.501370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f could not be found. Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f could not be found. Aug 30 01:19:38.503006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:19:38.504197 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-85eee3ac-8db0-4d8b-988d-991341395c82 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Returning 404 to user: Instance 89032f52-7c5b-4ce4-bbb5-9358b2c1f80f could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:19:38.504197 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-85eee3ac-8db0-4d8b-988d-991341395c82 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f" status: 404 len: 111 microversion: 2.1 time: 0.041733 Aug 30 01:19:38.504197 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 155/301] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:38 2022] GET /compute/v2.1/servers/89032f52-7c5b-4ce4-bbb5-9358b2c1f80f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:19:38.594515 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-246682186", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-482259432", "security_groups": [{"name": "tempest-secgroup-smoke-2124341128"}], "networks": [{"uuid": "d49c1cad-8850-407e-b0e1-c419feebc1a4"}], "block_device_mapping_v2": [{"uuid": "5da320d3-257a-4abe-9c56-c2d8a984a840", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:19:38.830655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] validate_networks() for [('d49c1cad-8850-407e-b0e1-c419feebc1a4', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:19:39.656570 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:19:39.657385 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:19:39.658436 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:19:39.659224 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:19:39.660217 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:19:39.678433 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:39.678941 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:39.679361 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:39.680671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:39.681127 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:39.681546 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:39.701857 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Getting quotas for project 089c19009d374769a0d5bd5a82acaaa7. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:19:39.708577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Getting quotas for user e76eba6f76f84c5cb006e079aa86157a and project 089c19009d374769a0d5bd5a82acaaa7. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:19:39.780930 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:19:39.783504 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5da320d3-257a-4abe-9c56-c2d8a984a840',volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:19:39.964780 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c66257fc-5ed9-44ce-a5a3-37bef6e23c87 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.377059 Aug 30 01:19:39.965444 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 147/302] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:19:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:19:39.984489 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c79adb42-bf55-4c31-843e-c08cf86f79c2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:39.985560 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c79adb42-bf55-4c31-843e-c08cf86f79c2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:40.051145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c79adb42-bf55-4c31-843e-c08cf86f79c2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:40.063086 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c79adb42-bf55-4c31-843e-c08cf86f79c2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1087 microversion: 2.1 time: 0.085274 Aug 30 01:19:40.064081 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 156/303] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:39 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1087 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:19:41.095418 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-79a3290b-1dd9-4793-a5d3-b17c5063d514 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:41.095963 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-79a3290b-1dd9-4793-a5d3-b17c5063d514 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:41.102448 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-79a3290b-1dd9-4793-a5d3-b17c5063d514 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:41.102928 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-79a3290b-1dd9-4793-a5d3-b17c5063d514 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:41.103365 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-79a3290b-1dd9-4793-a5d3-b17c5063d514 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:41.104102 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-79a3290b-1dd9-4793-a5d3-b17c5063d514 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:41.104559 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-79a3290b-1dd9-4793-a5d3-b17c5063d514 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:41.104979 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-79a3290b-1dd9-4793-a5d3-b17c5063d514 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:41.170419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-79a3290b-1dd9-4793-a5d3-b17c5063d514 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:41.178918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-79a3290b-1dd9-4793-a5d3-b17c5063d514 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1137 microversion: 2.1 time: 0.087828 Aug 30 01:19:41.180091 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 148/304] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:41 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1137 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:42.201835 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-63a4ba7c-09c1-4c28-9f18-0e18469e015d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:42.202493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-63a4ba7c-09c1-4c28-9f18-0e18469e015d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:42.212352 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63a4ba7c-09c1-4c28-9f18-0e18469e015d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:42.213150 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63a4ba7c-09c1-4c28-9f18-0e18469e015d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:42.213882 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63a4ba7c-09c1-4c28-9f18-0e18469e015d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:42.215083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63a4ba7c-09c1-4c28-9f18-0e18469e015d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:42.216236 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63a4ba7c-09c1-4c28-9f18-0e18469e015d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:42.217083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63a4ba7c-09c1-4c28-9f18-0e18469e015d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:42.306675 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-63a4ba7c-09c1-4c28-9f18-0e18469e015d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:42.315367 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-63a4ba7c-09c1-4c28-9f18-0e18469e015d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1185 microversion: 2.1 time: 0.117339 Aug 30 01:19:42.315949 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 157/305] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:42 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:43.337732 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-27c80175-5f93-49c2-a8f4-4e4eea14c61d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:43.338606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-27c80175-5f93-49c2-a8f4-4e4eea14c61d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:43.347216 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-27c80175-5f93-49c2-a8f4-4e4eea14c61d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:43.347901 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-27c80175-5f93-49c2-a8f4-4e4eea14c61d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:43.348793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-27c80175-5f93-49c2-a8f4-4e4eea14c61d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:43.349676 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-27c80175-5f93-49c2-a8f4-4e4eea14c61d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:43.350286 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-27c80175-5f93-49c2-a8f4-4e4eea14c61d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:43.350852 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-27c80175-5f93-49c2-a8f4-4e4eea14c61d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:43.434740 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-27c80175-5f93-49c2-a8f4-4e4eea14c61d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:43.446919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-27c80175-5f93-49c2-a8f4-4e4eea14c61d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1203 microversion: 2.1 time: 0.113309 Aug 30 01:19:43.447749 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 149/306] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:43 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1203 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:19:44.362024 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-c49eff43-7db1-4da4-9667-e5acc7fa9255 req-a95d918b-4430-460b-a95d-344eceaecb80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68833d42-7eed-4b4c-b315-842b9c015dfd", "tag": "90cf8014-421d-45c2-8701-cc67f5ad29d1"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:19:44.377619 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-c49eff43-7db1-4da4-9667-e5acc7fa9255 req-a95d918b-4430-460b-a95d-344eceaecb80 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:44.378754 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-c49eff43-7db1-4da4-9667-e5acc7fa9255 req-a95d918b-4430-460b-a95d-344eceaecb80 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:44.379732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-c49eff43-7db1-4da4-9667-e5acc7fa9255 req-a95d918b-4430-460b-a95d-344eceaecb80 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:44.394567 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-c49eff43-7db1-4da4-9667-e5acc7fa9255 req-a95d918b-4430-460b-a95d-344eceaecb80 service nova] Creating event network-changed:90cf8014-421d-45c2-8701-cc67f5ad29d1 for instance 68833d42-7eed-4b4c-b315-842b9c015dfd on hv-cinder-81514 Aug 30 01:19:44.402417 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-c49eff43-7db1-4da4-9667-e5acc7fa9255 req-a95d918b-4430-460b-a95d-344eceaecb80 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045285 Aug 30 01:19:44.403792 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 158/307] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:19:44.474245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-eac42cf5-b90f-46f7-85eb-7742b135c3a0 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:44.475703 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-eac42cf5-b90f-46f7-85eb-7742b135c3a0 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:44.484690 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eac42cf5-b90f-46f7-85eb-7742b135c3a0 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:44.485863 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eac42cf5-b90f-46f7-85eb-7742b135c3a0 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:44.487415 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eac42cf5-b90f-46f7-85eb-7742b135c3a0 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:44.488977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eac42cf5-b90f-46f7-85eb-7742b135c3a0 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:44.490038 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eac42cf5-b90f-46f7-85eb-7742b135c3a0 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:44.491211 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eac42cf5-b90f-46f7-85eb-7742b135c3a0 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:44.761123 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-eac42cf5-b90f-46f7-85eb-7742b135c3a0 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:44.773400 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-eac42cf5-b90f-46f7-85eb-7742b135c3a0 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1259 microversion: 2.1 time: 0.305367 Aug 30 01:19:44.787604 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 150/308] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:44 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1259 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:45.796211 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-71b02341-422f-4112-b4bd-975f90b92469 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:45.796901 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-71b02341-422f-4112-b4bd-975f90b92469 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:45.804757 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-71b02341-422f-4112-b4bd-975f90b92469 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:45.805622 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-71b02341-422f-4112-b4bd-975f90b92469 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:45.805737 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-71b02341-422f-4112-b4bd-975f90b92469 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:45.806364 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-71b02341-422f-4112-b4bd-975f90b92469 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:45.807090 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-71b02341-422f-4112-b4bd-975f90b92469 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:45.807519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-71b02341-422f-4112-b4bd-975f90b92469 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:45.966807 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-71b02341-422f-4112-b4bd-975f90b92469 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:45.979178 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-71b02341-422f-4112-b4bd-975f90b92469 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1259 microversion: 2.1 time: 0.187579 Aug 30 01:19:45.979774 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 159/309] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:45 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:47.003800 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-17e075eb-4e5d-4c67-988c-2327644513dc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:47.004521 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-17e075eb-4e5d-4c67-988c-2327644513dc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:47.016932 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-17e075eb-4e5d-4c67-988c-2327644513dc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:47.017417 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-17e075eb-4e5d-4c67-988c-2327644513dc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:47.017857 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-17e075eb-4e5d-4c67-988c-2327644513dc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:47.018561 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-17e075eb-4e5d-4c67-988c-2327644513dc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:47.019011 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-17e075eb-4e5d-4c67-988c-2327644513dc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:47.019434 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-17e075eb-4e5d-4c67-988c-2327644513dc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:47.266511 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-17e075eb-4e5d-4c67-988c-2327644513dc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:47.276832 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-17e075eb-4e5d-4c67-988c-2327644513dc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1259 microversion: 2.1 time: 0.276758 Aug 30 01:19:47.277503 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 151/310] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:46 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1259 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:47.913386 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-697913858", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "networks": [{"uuid": "3e2aeb58-3a7d-4703-af37-5e4bc1626f59"}]}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:19:47.984052 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] validate_networks() for [('3e2aeb58-3a7d-4703-af37-5e4bc1626f59', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:19:48.310187 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-35f23c55-0259-412b-8781-325714d8aa10 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:48.311062 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-35f23c55-0259-412b-8781-325714d8aa10 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:48.329007 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35f23c55-0259-412b-8781-325714d8aa10 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:48.332546 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35f23c55-0259-412b-8781-325714d8aa10 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:48.333736 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35f23c55-0259-412b-8781-325714d8aa10 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:48.336398 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35f23c55-0259-412b-8781-325714d8aa10 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:48.339913 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35f23c55-0259-412b-8781-325714d8aa10 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:48.341126 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35f23c55-0259-412b-8781-325714d8aa10 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:48.635054 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-35f23c55-0259-412b-8781-325714d8aa10 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:48.656513 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-35f23c55-0259-412b-8781-325714d8aa10 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1259 microversion: 2.1 time: 0.349668 Aug 30 01:19:48.657635 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 152/311] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:48 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1259 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:19:49.437131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:19:49.437814 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:19:49.438444 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:19:49.438987 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:19:49.439538 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:19:49.451363 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:49.451975 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:49.452584 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:49.453472 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:49.454037 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:49.454560 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:49.474100 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Getting quotas for project 2815adc7e64040c8986b1bd3f4519343. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:19:49.479241 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Getting quotas for user 64b579837fb4434282224eb7b83e57ab and project 2815adc7e64040c8986b1bd3f4519343. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:19:49.491915 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:19:49.494497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:19:49.547002 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8e6f2c2d-32c5-432c-bbec-dea7a8185e92 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.637763 Aug 30 01:19:49.554704 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 160/312] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:19:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:19:49.564420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-32c9d449-745a-4715-b7d1-ac2905e106a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:49.566473 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-32c9d449-745a-4715-b7d1-ac2905e106a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:49.641430 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-32c9d449-745a-4715-b7d1-ac2905e106a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:49.651099 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-32c9d449-745a-4715-b7d1-ac2905e106a0 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1218 microversion: 2.1 time: 0.094112 Aug 30 01:19:49.651856 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 153/313] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:49 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:19:49.696429 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-542c40dd-95af-4846-b777-c0fcd69be8f4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:49.697049 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-542c40dd-95af-4846-b777-c0fcd69be8f4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:49.716096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-542c40dd-95af-4846-b777-c0fcd69be8f4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:49.719109 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-542c40dd-95af-4846-b777-c0fcd69be8f4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:49.719432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-542c40dd-95af-4846-b777-c0fcd69be8f4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:49.720362 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-542c40dd-95af-4846-b777-c0fcd69be8f4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:49.720892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-542c40dd-95af-4846-b777-c0fcd69be8f4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:49.721381 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-542c40dd-95af-4846-b777-c0fcd69be8f4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:50.058118 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-542c40dd-95af-4846-b777-c0fcd69be8f4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:50.073952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-542c40dd-95af-4846-b777-c0fcd69be8f4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1259 microversion: 2.1 time: 0.379756 Aug 30 01:19:50.078024 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 161/314] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:49 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1259 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:19:50.671813 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-23fc1546-3175-4637-b4e2-bc086b74aeeb tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:50.673197 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-23fc1546-3175-4637-b4e2-bc086b74aeeb tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:50.676109 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:50.684997 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23fc1546-3175-4637-b4e2-bc086b74aeeb tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:50.685777 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23fc1546-3175-4637-b4e2-bc086b74aeeb tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:50.686434 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23fc1546-3175-4637-b4e2-bc086b74aeeb tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:50.687325 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23fc1546-3175-4637-b4e2-bc086b74aeeb tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:50.687947 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23fc1546-3175-4637-b4e2-bc086b74aeeb tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:50.688545 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23fc1546-3175-4637-b4e2-bc086b74aeeb tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:50.838574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-23fc1546-3175-4637-b4e2-bc086b74aeeb tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:50.858296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-23fc1546-3175-4637-b4e2-bc086b74aeeb tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1270 microversion: 2.1 time: 0.190644 Aug 30 01:19:50.860021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 154/315] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:50 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1270 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:51.114105 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-385dbcd5-d653-4e51-9fc7-e5c4ed38059e tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:51.114987 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-385dbcd5-d653-4e51-9fc7-e5c4ed38059e tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:51.146739 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-385dbcd5-d653-4e51-9fc7-e5c4ed38059e tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:51.149063 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-385dbcd5-d653-4e51-9fc7-e5c4ed38059e tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:51.149906 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-385dbcd5-d653-4e51-9fc7-e5c4ed38059e tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:51.151235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-385dbcd5-d653-4e51-9fc7-e5c4ed38059e tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:51.154949 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-385dbcd5-d653-4e51-9fc7-e5c4ed38059e tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:51.156909 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-385dbcd5-d653-4e51-9fc7-e5c4ed38059e tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:51.637464 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-385dbcd5-d653-4e51-9fc7-e5c4ed38059e tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:51.657022 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-385dbcd5-d653-4e51-9fc7-e5c4ed38059e tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1259 microversion: 2.1 time: 0.563619 Aug 30 01:19:51.658088 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 162/316] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:51 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1259 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:51.888626 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d912780a-be90-4a64-bb18-6e0d99a01ef3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:51.889707 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d912780a-be90-4a64-bb18-6e0d99a01ef3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:51.901868 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d912780a-be90-4a64-bb18-6e0d99a01ef3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:51.902698 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d912780a-be90-4a64-bb18-6e0d99a01ef3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:51.903715 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d912780a-be90-4a64-bb18-6e0d99a01ef3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:51.905493 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d912780a-be90-4a64-bb18-6e0d99a01ef3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:51.906596 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d912780a-be90-4a64-bb18-6e0d99a01ef3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:51.907981 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d912780a-be90-4a64-bb18-6e0d99a01ef3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:52.016188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d912780a-be90-4a64-bb18-6e0d99a01ef3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:52.025311 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d912780a-be90-4a64-bb18-6e0d99a01ef3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1276 microversion: 2.1 time: 0.145045 Aug 30 01:19:52.026029 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 155/317] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:51 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:52.680067 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-17955c64-1905-4ec3-9ddf-c162d686d509 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:52.680840 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-17955c64-1905-4ec3-9ddf-c162d686d509 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:52.693081 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17955c64-1905-4ec3-9ddf-c162d686d509 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:52.693568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17955c64-1905-4ec3-9ddf-c162d686d509 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:52.694317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17955c64-1905-4ec3-9ddf-c162d686d509 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:52.695040 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17955c64-1905-4ec3-9ddf-c162d686d509 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:52.695495 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17955c64-1905-4ec3-9ddf-c162d686d509 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:52.698928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17955c64-1905-4ec3-9ddf-c162d686d509 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:52.774852 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-94319363", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-799326755", "security_groups": [{"name": "tempest-secgroup-smoke-1498413457"}], "block_device_mapping_v2": [{"uuid": "b6aa8b84-aa3f-4278-ae8f-9f817f8dade5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "12ed87b9-c5b4-42d2-a401-f5a13e16f9c3"}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:19:52.947698 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] validate_networks() for [('12ed87b9-c5b4-42d2-a401-f5a13e16f9c3', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:19:53.059460 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-17955c64-1905-4ec3-9ddf-c162d686d509 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:53.075327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-17955c64-1905-4ec3-9ddf-c162d686d509 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1259 microversion: 2.1 time: 0.400004 Aug 30 01:19:53.077151 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 163/318] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:52 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1259 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:53.094532 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6f3aad32-8e96-4a87-9f6e-fca5c6b48cee tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:53.095648 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6f3aad32-8e96-4a87-9f6e-fca5c6b48cee tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:53.117788 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f3aad32-8e96-4a87-9f6e-fca5c6b48cee tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:53.119219 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f3aad32-8e96-4a87-9f6e-fca5c6b48cee tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:53.120288 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f3aad32-8e96-4a87-9f6e-fca5c6b48cee tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:53.121798 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f3aad32-8e96-4a87-9f6e-fca5c6b48cee tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:53.122869 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f3aad32-8e96-4a87-9f6e-fca5c6b48cee tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:53.123878 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f3aad32-8e96-4a87-9f6e-fca5c6b48cee tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:53.332022 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6f3aad32-8e96-4a87-9f6e-fca5c6b48cee tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:53.341426 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6f3aad32-8e96-4a87-9f6e-fca5c6b48cee tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1318 microversion: 2.1 time: 0.262962 Aug 30 01:19:53.342025 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 164/319] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:53 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:53.488103 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:19:53.488610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:19:53.489830 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:19:53.490257 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:19:53.490672 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:19:53.501797 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:53.502468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:53.503243 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:53.504553 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:53.505609 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:53.506400 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:53.541574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Getting quotas for project 20cdcff29a0448dc92460b2ddd45617b. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:19:53.551138 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Getting quotas for user 2839103f52324a1ab1ebd43fe230addc and project 20cdcff29a0448dc92460b2ddd45617b. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:19:53.664879 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:19:53.667039 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6aa8b84-aa3f-4278-ae8f-9f817f8dade5',volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:19:53.854873 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-af5126e0-8dfe-46a8-9a7e-ea8deef647cc tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.084348 Aug 30 01:19:53.855640 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 156/320] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:19:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:19:53.883214 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8e223fbb-2068-43a2-b707-3064177e4ff6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:53.889871 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8e223fbb-2068-43a2-b707-3064177e4ff6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:54.089899 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8e223fbb-2068-43a2-b707-3064177e4ff6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:54.104463 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e0d68b6e-ccf8-4bcf-99d1-1de4d8a9b176 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:54.112468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e0d68b6e-ccf8-4bcf-99d1-1de4d8a9b176 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:54.120603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8e223fbb-2068-43a2-b707-3064177e4ff6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1092 microversion: 2.1 time: 0.253399 Aug 30 01:19:54.122919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 165/321] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:53 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1092 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:54.139841 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0d68b6e-ccf8-4bcf-99d1-1de4d8a9b176 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:54.142813 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0d68b6e-ccf8-4bcf-99d1-1de4d8a9b176 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:54.145254 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0d68b6e-ccf8-4bcf-99d1-1de4d8a9b176 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:54.150217 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0d68b6e-ccf8-4bcf-99d1-1de4d8a9b176 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:54.150720 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0d68b6e-ccf8-4bcf-99d1-1de4d8a9b176 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:54.151171 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0d68b6e-ccf8-4bcf-99d1-1de4d8a9b176 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:54.364058 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1b758434-4010-41e6-abf4-ced345c0e77c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:54.364954 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1b758434-4010-41e6-abf4-ced345c0e77c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:54.383750 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b758434-4010-41e6-abf4-ced345c0e77c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:54.384332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b758434-4010-41e6-abf4-ced345c0e77c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:54.386408 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b758434-4010-41e6-abf4-ced345c0e77c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:54.388445 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b758434-4010-41e6-abf4-ced345c0e77c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:54.389068 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b758434-4010-41e6-abf4-ced345c0e77c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:54.390623 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b758434-4010-41e6-abf4-ced345c0e77c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:54.476059 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e0d68b6e-ccf8-4bcf-99d1-1de4d8a9b176 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:54.510539 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e0d68b6e-ccf8-4bcf-99d1-1de4d8a9b176 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1259 microversion: 2.1 time: 0.414051 Aug 30 01:19:54.525591 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 157/322] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:54 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1259 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:55.141594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1b758434-4010-41e6-abf4-ced345c0e77c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:55.144473 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9081af89-f389-455f-a3ce-e840470e9e98 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:55.146312 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9081af89-f389-455f-a3ce-e840470e9e98 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:55.166224 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9081af89-f389-455f-a3ce-e840470e9e98 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:55.168537 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9081af89-f389-455f-a3ce-e840470e9e98 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:55.169293 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9081af89-f389-455f-a3ce-e840470e9e98 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:55.171635 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9081af89-f389-455f-a3ce-e840470e9e98 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:55.175061 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9081af89-f389-455f-a3ce-e840470e9e98 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:55.175565 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1b758434-4010-41e6-abf4-ced345c0e77c tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1318 microversion: 2.1 time: 0.816518 Aug 30 01:19:55.176813 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 166/323] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:54 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1318 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:19:55.177808 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9081af89-f389-455f-a3ce-e840470e9e98 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:55.338740 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9081af89-f389-455f-a3ce-e840470e9e98 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:55.351058 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9081af89-f389-455f-a3ce-e840470e9e98 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1190 microversion: 2.1 time: 0.210970 Aug 30 01:19:55.351677 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 158/324] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:55 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1190 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:55.453887 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-b1695dbd-d585-4e71-a1c0-355735e724b3 req-9cc13114-2edb-4524-9d5e-16a0c2338ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0069d16b-f85d-43f1-a310-6036df89e8e1", "tag": "5b76e68a-559f-498b-b2ff-b979997a5a2d"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:19:55.489030 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b1695dbd-d585-4e71-a1c0-355735e724b3 req-9cc13114-2edb-4524-9d5e-16a0c2338ff9 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:55.493137 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b1695dbd-d585-4e71-a1c0-355735e724b3 req-9cc13114-2edb-4524-9d5e-16a0c2338ff9 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:55.495138 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b1695dbd-d585-4e71-a1c0-355735e724b3 req-9cc13114-2edb-4524-9d5e-16a0c2338ff9 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:55.534151 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b95a3b5f-c510-4969-9850-e186df3768b4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:55.535169 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-b1695dbd-d585-4e71-a1c0-355735e724b3 req-9cc13114-2edb-4524-9d5e-16a0c2338ff9 service nova] Creating event network-changed:5b76e68a-559f-498b-b2ff-b979997a5a2d for instance 0069d16b-f85d-43f1-a310-6036df89e8e1 on hv-cinder-81514 Aug 30 01:19:55.535423 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b95a3b5f-c510-4969-9850-e186df3768b4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:55.545385 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-b1695dbd-d585-4e71-a1c0-355735e724b3 req-9cc13114-2edb-4524-9d5e-16a0c2338ff9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095922 Aug 30 01:19:55.546721 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 167/325] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:19:55.552610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b95a3b5f-c510-4969-9850-e186df3768b4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:55.554483 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b95a3b5f-c510-4969-9850-e186df3768b4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:55.555214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b95a3b5f-c510-4969-9850-e186df3768b4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:55.556232 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b95a3b5f-c510-4969-9850-e186df3768b4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:55.557250 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b95a3b5f-c510-4969-9850-e186df3768b4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:55.557850 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b95a3b5f-c510-4969-9850-e186df3768b4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:55.814548 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b95a3b5f-c510-4969-9850-e186df3768b4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:55.821643 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:55.833167 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b95a3b5f-c510-4969-9850-e186df3768b4 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1259 microversion: 2.1 time: 0.303084 Aug 30 01:19:55.835361 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 159/326] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:55 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1259 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:56.207536 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-34e4d105-f053-4583-8a15-cb5ee90c98ae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:56.208423 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-34e4d105-f053-4583-8a15-cb5ee90c98ae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:56.222585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-34e4d105-f053-4583-8a15-cb5ee90c98ae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:56.223587 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-34e4d105-f053-4583-8a15-cb5ee90c98ae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:56.224673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-34e4d105-f053-4583-8a15-cb5ee90c98ae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:56.228710 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-34e4d105-f053-4583-8a15-cb5ee90c98ae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:56.229334 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-34e4d105-f053-4583-8a15-cb5ee90c98ae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:56.229850 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-34e4d105-f053-4583-8a15-cb5ee90c98ae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:56.393997 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b33bc2a5-3b6d-4faf-837b-ff2da08ecb71 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:56.396278 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b33bc2a5-3b6d-4faf-837b-ff2da08ecb71 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:56.432419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b33bc2a5-3b6d-4faf-837b-ff2da08ecb71 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:56.433184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b33bc2a5-3b6d-4faf-837b-ff2da08ecb71 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:56.433866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b33bc2a5-3b6d-4faf-837b-ff2da08ecb71 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:56.434855 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b33bc2a5-3b6d-4faf-837b-ff2da08ecb71 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:56.435283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b33bc2a5-3b6d-4faf-837b-ff2da08ecb71 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:56.435921 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b33bc2a5-3b6d-4faf-837b-ff2da08ecb71 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:56.650014 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b33bc2a5-3b6d-4faf-837b-ff2da08ecb71 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:56.660331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b33bc2a5-3b6d-4faf-837b-ff2da08ecb71 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1208 microversion: 2.1 time: 0.290215 Aug 30 01:19:56.661236 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 160/327] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:56 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1208 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:56.859967 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ca371d32-a46f-487f-9cf5-663cba0bddba tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:56.860653 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ca371d32-a46f-487f-9cf5-663cba0bddba tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:56.877360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca371d32-a46f-487f-9cf5-663cba0bddba tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:56.898640 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca371d32-a46f-487f-9cf5-663cba0bddba tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:56.899922 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca371d32-a46f-487f-9cf5-663cba0bddba tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:56.901216 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca371d32-a46f-487f-9cf5-663cba0bddba tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:56.902157 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca371d32-a46f-487f-9cf5-663cba0bddba tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:56.906585 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca371d32-a46f-487f-9cf5-663cba0bddba tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:56.908452 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-34e4d105-f053-4583-8a15-cb5ee90c98ae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:56.917884 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-34e4d105-f053-4583-8a15-cb5ee90c98ae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1318 microversion: 2.1 time: 0.714684 Aug 30 01:19:56.927233 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 168/328] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:56 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1318 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:57.300606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ca371d32-a46f-487f-9cf5-663cba0bddba tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:57.311610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ca371d32-a46f-487f-9cf5-663cba0bddba tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1259 microversion: 2.1 time: 0.458625 Aug 30 01:19:57.312246 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 161/329] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:56 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1259 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:19:57.703206 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-629976f0-9814-4de2-ba26-5d025b6a5b2f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:57.721077 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-629976f0-9814-4de2-ba26-5d025b6a5b2f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:57.736510 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-629976f0-9814-4de2-ba26-5d025b6a5b2f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:57.737479 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-629976f0-9814-4de2-ba26-5d025b6a5b2f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:57.738802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-629976f0-9814-4de2-ba26-5d025b6a5b2f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:57.739734 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-629976f0-9814-4de2-ba26-5d025b6a5b2f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:57.740916 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-629976f0-9814-4de2-ba26-5d025b6a5b2f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:57.741512 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-629976f0-9814-4de2-ba26-5d025b6a5b2f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:57.819370 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-afa390e4-338c-4637-95cc-09978355615f req-de2332c6-e80f-4296-bdff-d3cddb735ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68833d42-7eed-4b4c-b315-842b9c015dfd", "name": "network-vif-plugged", "status": "completed", "tag": "90cf8014-421d-45c2-8701-cc67f5ad29d1"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:19:57.849368 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-afa390e4-338c-4637-95cc-09978355615f req-de2332c6-e80f-4296-bdff-d3cddb735ba1 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:57.849938 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-afa390e4-338c-4637-95cc-09978355615f req-de2332c6-e80f-4296-bdff-d3cddb735ba1 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:57.850383 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-afa390e4-338c-4637-95cc-09978355615f req-de2332c6-e80f-4296-bdff-d3cddb735ba1 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:57.883989 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-afa390e4-338c-4637-95cc-09978355615f req-de2332c6-e80f-4296-bdff-d3cddb735ba1 service nova] Creating event network-vif-plugged:90cf8014-421d-45c2-8701-cc67f5ad29d1 for instance 68833d42-7eed-4b4c-b315-842b9c015dfd on hv-cinder-81514 Aug 30 01:19:57.900031 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-afa390e4-338c-4637-95cc-09978355615f req-de2332c6-e80f-4296-bdff-d3cddb735ba1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090030 Aug 30 01:19:57.905575 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 162/330] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:19:57.972139 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7ca0293b-a5e6-4284-a12d-dba2ec37d0dc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:57.973208 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7ca0293b-a5e6-4284-a12d-dba2ec37d0dc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:58.005739 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ca0293b-a5e6-4284-a12d-dba2ec37d0dc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:58.012824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ca0293b-a5e6-4284-a12d-dba2ec37d0dc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:58.015861 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ca0293b-a5e6-4284-a12d-dba2ec37d0dc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:58.018585 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ca0293b-a5e6-4284-a12d-dba2ec37d0dc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:58.019474 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ca0293b-a5e6-4284-a12d-dba2ec37d0dc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:58.021095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ca0293b-a5e6-4284-a12d-dba2ec37d0dc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:58.437509 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7ca0293b-a5e6-4284-a12d-dba2ec37d0dc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:58.449056 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7ca0293b-a5e6-4284-a12d-dba2ec37d0dc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1318 microversion: 2.1 time: 0.487587 Aug 30 01:19:58.450363 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 163/331] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:57 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:58.460527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-caee966c-3e89-4db8-b8db-e9df308f4da8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:58.461835 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-caee966c-3e89-4db8-b8db-e9df308f4da8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:58.487548 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-caee966c-3e89-4db8-b8db-e9df308f4da8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:58.489375 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-caee966c-3e89-4db8-b8db-e9df308f4da8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:58.490041 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-caee966c-3e89-4db8-b8db-e9df308f4da8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:58.491960 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-caee966c-3e89-4db8-b8db-e9df308f4da8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:58.493137 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-caee966c-3e89-4db8-b8db-e9df308f4da8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:58.494125 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-caee966c-3e89-4db8-b8db-e9df308f4da8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:58.751736 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-629976f0-9814-4de2-ba26-5d025b6a5b2f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:58.763025 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-629976f0-9814-4de2-ba26-5d025b6a5b2f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1276 microversion: 2.1 time: 1.068859 Aug 30 01:19:58.765781 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 169/332] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:57 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1276 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:58.953663 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-caee966c-3e89-4db8-b8db-e9df308f4da8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:59.013677 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-caee966c-3e89-4db8-b8db-e9df308f4da8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1259 microversion: 2.1 time: 0.558533 Aug 30 01:19:59.047453 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 164/333] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:58 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1259 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:19:59.489562 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-320d082e-7562-48a4-8a0c-288c22ab78f9 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:59.490908 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-320d082e-7562-48a4-8a0c-288c22ab78f9 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:59.493135 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:59.496667 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-480ede03-ba75-4e6e-bfdf-4f1af8bfc754 req-40ef58d4-2a9a-411e-b51b-5f27260b23d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "806ac720-5f83-41ac-8053-3debfda5295d", "tag": "f8872fed-3b35-451c-ae5b-1a2e7790acd0"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:19:59.501910 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-320d082e-7562-48a4-8a0c-288c22ab78f9 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:59.506083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-320d082e-7562-48a4-8a0c-288c22ab78f9 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:59.506698 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-320d082e-7562-48a4-8a0c-288c22ab78f9 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:59.508263 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-320d082e-7562-48a4-8a0c-288c22ab78f9 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:59.510051 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-320d082e-7562-48a4-8a0c-288c22ab78f9 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:59.512123 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-320d082e-7562-48a4-8a0c-288c22ab78f9 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:59.517840 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-480ede03-ba75-4e6e-bfdf-4f1af8bfc754 req-40ef58d4-2a9a-411e-b51b-5f27260b23d2 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:59.519551 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-480ede03-ba75-4e6e-bfdf-4f1af8bfc754 req-40ef58d4-2a9a-411e-b51b-5f27260b23d2 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:59.520644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-480ede03-ba75-4e6e-bfdf-4f1af8bfc754 req-40ef58d4-2a9a-411e-b51b-5f27260b23d2 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:59.546186 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-480ede03-ba75-4e6e-bfdf-4f1af8bfc754 req-40ef58d4-2a9a-411e-b51b-5f27260b23d2 service nova] Creating event network-changed:f8872fed-3b35-451c-ae5b-1a2e7790acd0 for instance 806ac720-5f83-41ac-8053-3debfda5295d on hv-cinder-81514 Aug 30 01:19:59.559277 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-480ede03-ba75-4e6e-bfdf-4f1af8bfc754 req-40ef58d4-2a9a-411e-b51b-5f27260b23d2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071766 Aug 30 01:19:59.561745 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 165/334] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 30 01:19:59.794792 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d4375007-2b5e-4165-9fa1-d532658a0830 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:19:59.795510 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d4375007-2b5e-4165-9fa1-d532658a0830 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:19:59.802317 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d4375007-2b5e-4165-9fa1-d532658a0830 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:59.802878 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d4375007-2b5e-4165-9fa1-d532658a0830 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:59.803318 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d4375007-2b5e-4165-9fa1-d532658a0830 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:59.804727 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d4375007-2b5e-4165-9fa1-d532658a0830 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:19:59.805199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d4375007-2b5e-4165-9fa1-d532658a0830 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:19:59.805617 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d4375007-2b5e-4165-9fa1-d532658a0830 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:19:59.951244 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-320d082e-7562-48a4-8a0c-288c22ab78f9 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:19:59.979775 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:59.986245 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-320d082e-7562-48a4-8a0c-288c22ab78f9 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1318 microversion: 2.1 time: 0.500201 Aug 30 01:20:00.013149 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 170/335] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:59 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:00.069581 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a37eacd2-9fa2-45f9-b60f-f7e65fdb0698 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:00.070894 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a37eacd2-9fa2-45f9-b60f-f7e65fdb0698 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:00.089134 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:00.095904 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a37eacd2-9fa2-45f9-b60f-f7e65fdb0698 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:00.101186 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a37eacd2-9fa2-45f9-b60f-f7e65fdb0698 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:00.102700 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a37eacd2-9fa2-45f9-b60f-f7e65fdb0698 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:00.104490 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a37eacd2-9fa2-45f9-b60f-f7e65fdb0698 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:00.105646 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a37eacd2-9fa2-45f9-b60f-f7e65fdb0698 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:00.106679 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a37eacd2-9fa2-45f9-b60f-f7e65fdb0698 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:00.529742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d4375007-2b5e-4165-9fa1-d532658a0830 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:00.539665 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d4375007-2b5e-4165-9fa1-d532658a0830 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1264 microversion: 2.1 time: 0.749044 Aug 30 01:20:00.554237 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 166/336] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:19:59 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1264 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:00.618044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a37eacd2-9fa2-45f9-b60f-f7e65fdb0698 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:00.632290 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a37eacd2-9fa2-45f9-b60f-f7e65fdb0698 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1259 microversion: 2.1 time: 0.582079 Aug 30 01:20:00.636266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 171/337] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:00 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1259 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:01.030348 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c85aadb7-0199-4e89-82c2-028ebc8b2d24 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:01.031627 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c85aadb7-0199-4e89-82c2-028ebc8b2d24 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:01.045937 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c85aadb7-0199-4e89-82c2-028ebc8b2d24 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:01.047197 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c85aadb7-0199-4e89-82c2-028ebc8b2d24 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:01.048529 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c85aadb7-0199-4e89-82c2-028ebc8b2d24 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:01.050287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c85aadb7-0199-4e89-82c2-028ebc8b2d24 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:01.051548 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c85aadb7-0199-4e89-82c2-028ebc8b2d24 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:01.052794 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c85aadb7-0199-4e89-82c2-028ebc8b2d24 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:01.457014 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c85aadb7-0199-4e89-82c2-028ebc8b2d24 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:01.490453 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c85aadb7-0199-4e89-82c2-028ebc8b2d24 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1318 microversion: 2.1 time: 0.467028 Aug 30 01:20:01.492469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 167/338] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:01 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:01.566314 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5b7b1c78-78c2-4d6f-a9ed-83b131e1e703 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:01.567228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5b7b1c78-78c2-4d6f-a9ed-83b131e1e703 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:01.577284 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5b7b1c78-78c2-4d6f-a9ed-83b131e1e703 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:01.578060 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5b7b1c78-78c2-4d6f-a9ed-83b131e1e703 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:01.578697 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5b7b1c78-78c2-4d6f-a9ed-83b131e1e703 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:01.580479 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5b7b1c78-78c2-4d6f-a9ed-83b131e1e703 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:01.581189 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5b7b1c78-78c2-4d6f-a9ed-83b131e1e703 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:01.581782 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5b7b1c78-78c2-4d6f-a9ed-83b131e1e703 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:01.663720 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-39d829b5-9c28-4492-abc0-85a616fba129 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:01.666017 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-39d829b5-9c28-4492-abc0-85a616fba129 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:01.673907 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39d829b5-9c28-4492-abc0-85a616fba129 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:01.674817 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39d829b5-9c28-4492-abc0-85a616fba129 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:01.675477 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39d829b5-9c28-4492-abc0-85a616fba129 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:01.679610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39d829b5-9c28-4492-abc0-85a616fba129 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:01.680765 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39d829b5-9c28-4492-abc0-85a616fba129 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:01.681495 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39d829b5-9c28-4492-abc0-85a616fba129 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:01.983227 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5b7b1c78-78c2-4d6f-a9ed-83b131e1e703 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:02.007007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5b7b1c78-78c2-4d6f-a9ed-83b131e1e703 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1264 microversion: 2.1 time: 0.445062 Aug 30 01:20:02.007664 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 172/339] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:01 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1264 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:02.024231 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-39d829b5-9c28-4492-abc0-85a616fba129 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:02.035300 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-39d829b5-9c28-4492-abc0-85a616fba129 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1443 microversion: 2.1 time: 0.378473 Aug 30 01:20:02.038509 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 168/340] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:01 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1443 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:02.059969 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2f39cc50-0267-49e6-8369-880c5ff02b84 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:02.063161 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2f39cc50-0267-49e6-8369-880c5ff02b84 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:02.075568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2f39cc50-0267-49e6-8369-880c5ff02b84 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:02.076939 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2f39cc50-0267-49e6-8369-880c5ff02b84 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:02.077978 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2f39cc50-0267-49e6-8369-880c5ff02b84 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:02.082970 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2f39cc50-0267-49e6-8369-880c5ff02b84 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:02.084765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2f39cc50-0267-49e6-8369-880c5ff02b84 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:02.086256 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2f39cc50-0267-49e6-8369-880c5ff02b84 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:02.352433 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2f39cc50-0267-49e6-8369-880c5ff02b84 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:02.385356 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2f39cc50-0267-49e6-8369-880c5ff02b84 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1443 microversion: 2.1 time: 0.325950 Aug 30 01:20:02.388063 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 173/341] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:02 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1443 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:02.540445 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6711bf2c-f20c-4d69-a33a-4b0b8b8cc928 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:02.540995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6711bf2c-f20c-4d69-a33a-4b0b8b8cc928 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:02.544047 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:02.556677 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6711bf2c-f20c-4d69-a33a-4b0b8b8cc928 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:02.557439 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6711bf2c-f20c-4d69-a33a-4b0b8b8cc928 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:02.558015 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6711bf2c-f20c-4d69-a33a-4b0b8b8cc928 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:02.558984 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6711bf2c-f20c-4d69-a33a-4b0b8b8cc928 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:02.559524 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6711bf2c-f20c-4d69-a33a-4b0b8b8cc928 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:02.560300 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6711bf2c-f20c-4d69-a33a-4b0b8b8cc928 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:02.782354 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6711bf2c-f20c-4d69-a33a-4b0b8b8cc928 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:02.792200 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6711bf2c-f20c-4d69-a33a-4b0b8b8cc928 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1318 microversion: 2.1 time: 0.257589 Aug 30 01:20:02.793345 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 169/342] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:02 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:03.047790 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5f2ddcaf-c2c7-45ac-93fa-5ae9e90fdda1 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:03.063198 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5f2ddcaf-c2c7-45ac-93fa-5ae9e90fdda1 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:03.095873 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f2ddcaf-c2c7-45ac-93fa-5ae9e90fdda1 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:03.100641 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f2ddcaf-c2c7-45ac-93fa-5ae9e90fdda1 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:03.103172 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f2ddcaf-c2c7-45ac-93fa-5ae9e90fdda1 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:03.104958 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f2ddcaf-c2c7-45ac-93fa-5ae9e90fdda1 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:03.105834 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f2ddcaf-c2c7-45ac-93fa-5ae9e90fdda1 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:03.106843 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f2ddcaf-c2c7-45ac-93fa-5ae9e90fdda1 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:03.460605 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5f2ddcaf-c2c7-45ac-93fa-5ae9e90fdda1 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:03.478505 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5f2ddcaf-c2c7-45ac-93fa-5ae9e90fdda1 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1264 microversion: 2.1 time: 0.448409 Aug 30 01:20:03.497045 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8db02fcb-2f17-4cb0-abe7-b9ead09522af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47569380-a4e0-40e2-80c9-61f8f4a65d2a"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:03.501636 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 174/343] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:03 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1264 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:03.514471 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8db02fcb-2f17-4cb0-abe7-b9ead09522af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:03.525564 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:03.533725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8db02fcb-2f17-4cb0-abe7-b9ead09522af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:03.535216 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8db02fcb-2f17-4cb0-abe7-b9ead09522af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:03.539271 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8db02fcb-2f17-4cb0-abe7-b9ead09522af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:03.541020 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8db02fcb-2f17-4cb0-abe7-b9ead09522af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:03.542307 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8db02fcb-2f17-4cb0-abe7-b9ead09522af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:03.543418 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8db02fcb-2f17-4cb0-abe7-b9ead09522af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:03.569250 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=14 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:03.602097 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-780e51ca-cd13-4154-b36a-2db251c9d18b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:03.602801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-780e51ca-cd13-4154-b36a-2db251c9d18b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:03.633253 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-780e51ca-cd13-4154-b36a-2db251c9d18b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:03.635956 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-780e51ca-cd13-4154-b36a-2db251c9d18b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:03.638799 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-780e51ca-cd13-4154-b36a-2db251c9d18b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:03.641359 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-780e51ca-cd13-4154-b36a-2db251c9d18b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:03.643010 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-780e51ca-cd13-4154-b36a-2db251c9d18b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:03.643424 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-780e51ca-cd13-4154-b36a-2db251c9d18b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:04.006885 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-780e51ca-cd13-4154-b36a-2db251c9d18b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lazy-loading 'services' on Instance uuid 6657e20f-b2a0-4f01-9dca-fd276792dc73 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:20:04.125617 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=10 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:04.247331 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-780e51ca-cd13-4154-b36a-2db251c9d18b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/os-volume_attachments/4a423953-1b7b-4dda-8b5b-c187488731ac" status: 202 len: 0 microversion: 2.1 time: 0.659010 Aug 30 01:20:04.249823 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 175/344] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Aug 30 01:20:03 2022] DELETE /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/os-volume_attachments/4a423953-1b7b-4dda-8b5b-c187488731ac => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:20:04.289061 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-36df0f84-a09f-46fb-ae86-03cc2a6dc7b7 req-528f0884-5ee0-437d-bba3-f65519e8ad69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0069d16b-f85d-43f1-a310-6036df89e8e1", "name": "network-vif-plugged", "status": "completed", "tag": "5b76e68a-559f-498b-b2ff-b979997a5a2d"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:04.340949 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-36df0f84-a09f-46fb-ae86-03cc2a6dc7b7 req-528f0884-5ee0-437d-bba3-f65519e8ad69 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:04.341924 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-36df0f84-a09f-46fb-ae86-03cc2a6dc7b7 req-528f0884-5ee0-437d-bba3-f65519e8ad69 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:04.342705 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-36df0f84-a09f-46fb-ae86-03cc2a6dc7b7 req-528f0884-5ee0-437d-bba3-f65519e8ad69 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:04.383399 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-36df0f84-a09f-46fb-ae86-03cc2a6dc7b7 req-528f0884-5ee0-437d-bba3-f65519e8ad69 service nova] Creating event network-vif-plugged:5b76e68a-559f-498b-b2ff-b979997a5a2d for instance 0069d16b-f85d-43f1-a310-6036df89e8e1 on hv-cinder-81514 Aug 30 01:20:04.417945 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-36df0f84-a09f-46fb-ae86-03cc2a6dc7b7 req-528f0884-5ee0-437d-bba3-f65519e8ad69 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161704 Aug 30 01:20:04.424204 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 176/345] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:04.436985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b1d8576f-2781-405e-a695-b8289773939d tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:04.438209 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b1d8576f-2781-405e-a695-b8289773939d tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:04.453429 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b1d8576f-2781-405e-a695-b8289773939d tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:04.454540 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b1d8576f-2781-405e-a695-b8289773939d tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:04.455135 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b1d8576f-2781-405e-a695-b8289773939d tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:04.456087 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b1d8576f-2781-405e-a695-b8289773939d tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:04.456838 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b1d8576f-2781-405e-a695-b8289773939d tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:04.458278 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b1d8576f-2781-405e-a695-b8289773939d tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:04.577974 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8db02fcb-2f17-4cb0-abe7-b9ead09522af tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "POST /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.091589 Aug 30 01:20:04.582435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 170/346] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:20:03 2022] POST /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-volume_attachments => generated 194 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:04.625964 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9ba09db6-c92c-4d56-afee-2e6549f52049 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:04.636947 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9ba09db6-c92c-4d56-afee-2e6549f52049 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:04.684113 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ba09db6-c92c-4d56-afee-2e6549f52049 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:04.695665 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ba09db6-c92c-4d56-afee-2e6549f52049 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:04.696873 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ba09db6-c92c-4d56-afee-2e6549f52049 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:04.698803 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ba09db6-c92c-4d56-afee-2e6549f52049 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:04.700628 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ba09db6-c92c-4d56-afee-2e6549f52049 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:04.702819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ba09db6-c92c-4d56-afee-2e6549f52049 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:05.154580 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9ba09db6-c92c-4d56-afee-2e6549f52049 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:05.184520 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9ba09db6-c92c-4d56-afee-2e6549f52049 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1264 microversion: 2.1 time: 0.598868 Aug 30 01:20:05.185122 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 171/347] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:04 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1264 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:05.523133 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b1d8576f-2781-405e-a695-b8289773939d tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:05.534086 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b1d8576f-2781-405e-a695-b8289773939d tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1318 microversion: 2.1 time: 1.107519 Aug 30 01:20:05.534704 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 177/348] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:04 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1318 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:06.224596 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f5c53152-0bf7-409a-b798-ee8951f3af62 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:06.227385 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f5c53152-0bf7-409a-b798-ee8951f3af62 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:06.272736 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f5c53152-0bf7-409a-b798-ee8951f3af62 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:06.273765 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f5c53152-0bf7-409a-b798-ee8951f3af62 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:06.274618 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f5c53152-0bf7-409a-b798-ee8951f3af62 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:06.276104 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f5c53152-0bf7-409a-b798-ee8951f3af62 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:06.277065 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f5c53152-0bf7-409a-b798-ee8951f3af62 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:06.281690 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f5c53152-0bf7-409a-b798-ee8951f3af62 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:06.554440 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f5c53152-0bf7-409a-b798-ee8951f3af62 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:06.566329 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-17859561-6522-4150-a71f-adcf516d2739 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:06.567010 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-17859561-6522-4150-a71f-adcf516d2739 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:06.577240 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f5c53152-0bf7-409a-b798-ee8951f3af62 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1264 microversion: 2.1 time: 0.349262 Aug 30 01:20:06.584317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17859561-6522-4150-a71f-adcf516d2739 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:06.584819 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17859561-6522-4150-a71f-adcf516d2739 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:06.585408 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 172/349] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:06 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1264 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:06.589526 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17859561-6522-4150-a71f-adcf516d2739 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:06.590725 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17859561-6522-4150-a71f-adcf516d2739 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:06.591253 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17859561-6522-4150-a71f-adcf516d2739 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:06.591682 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17859561-6522-4150-a71f-adcf516d2739 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:06.766302 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0bdfe59b-a6e4-42da-a6da-3f07e1f96f5d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:06.774746 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0bdfe59b-a6e4-42da-a6da-3f07e1f96f5d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:06.775488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0bdfe59b-a6e4-42da-a6da-3f07e1f96f5d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:06.776145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0bdfe59b-a6e4-42da-a6da-3f07e1f96f5d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:06.878539 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0bdfe59b-a6e4-42da-a6da-3f07e1f96f5d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Going to try to stop instance {{(pid=120706) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 01:20:07.049562 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0bdfe59b-a6e4-42da-a6da-3f07e1f96f5d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "POST /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/action" status: 202 len: 0 microversion: 2.1 time: 0.287319 Aug 30 01:20:07.050914 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 173/350] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:20:06 2022] POST /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:20:07.070391 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-81be652c-19a7-42c1-91ff-c7c9dfa7accb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:07.073938 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-81be652c-19a7-42c1-91ff-c7c9dfa7accb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:07.090213 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81be652c-19a7-42c1-91ff-c7c9dfa7accb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:07.091005 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81be652c-19a7-42c1-91ff-c7c9dfa7accb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:07.091613 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81be652c-19a7-42c1-91ff-c7c9dfa7accb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:07.092769 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81be652c-19a7-42c1-91ff-c7c9dfa7accb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:07.093401 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81be652c-19a7-42c1-91ff-c7c9dfa7accb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:07.095016 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81be652c-19a7-42c1-91ff-c7c9dfa7accb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:07.172470 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-17859561-6522-4150-a71f-adcf516d2739 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:07.181930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-17859561-6522-4150-a71f-adcf516d2739 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1318 microversion: 2.1 time: 0.619653 Aug 30 01:20:07.182530 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 178/351] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:06 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1318 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:07.471542 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-81be652c-19a7-42c1-91ff-c7c9dfa7accb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:07.501361 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-81be652c-19a7-42c1-91ff-c7c9dfa7accb tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1677 microversion: 2.1 time: 0.442835 Aug 30 01:20:07.515665 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-74b5aa57-4b6b-4699-ba2d-4abfae1e2a73 req-88a2f8b3-03ce-4c2f-add9-81445be8f2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68833d42-7eed-4b4c-b315-842b9c015dfd", "tag": "90cf8014-421d-45c2-8701-cc67f5ad29d1"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:07.516224 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 174/352] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:07 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1677 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:07.537658 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-74b5aa57-4b6b-4699-ba2d-4abfae1e2a73 req-88a2f8b3-03ce-4c2f-add9-81445be8f2c2 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:07.538162 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-74b5aa57-4b6b-4699-ba2d-4abfae1e2a73 req-88a2f8b3-03ce-4c2f-add9-81445be8f2c2 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:07.538599 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-74b5aa57-4b6b-4699-ba2d-4abfae1e2a73 req-88a2f8b3-03ce-4c2f-add9-81445be8f2c2 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:07.568180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-74b5aa57-4b6b-4699-ba2d-4abfae1e2a73 req-88a2f8b3-03ce-4c2f-add9-81445be8f2c2 service nova] Creating event network-changed:90cf8014-421d-45c2-8701-cc67f5ad29d1 for instance 68833d42-7eed-4b4c-b315-842b9c015dfd on hv-cinder-81514 Aug 30 01:20:07.581234 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-74b5aa57-4b6b-4699-ba2d-4abfae1e2a73 req-88a2f8b3-03ce-4c2f-add9-81445be8f2c2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069834 Aug 30 01:20:07.583653 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 179/353] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:07.620997 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ca497d32-aaa6-4f42-9a7d-d196784568d9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:07.622321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ca497d32-aaa6-4f42-9a7d-d196784568d9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:07.637546 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca497d32-aaa6-4f42-9a7d-d196784568d9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:07.638384 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca497d32-aaa6-4f42-9a7d-d196784568d9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:07.639059 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca497d32-aaa6-4f42-9a7d-d196784568d9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:07.643034 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca497d32-aaa6-4f42-9a7d-d196784568d9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:07.646251 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca497d32-aaa6-4f42-9a7d-d196784568d9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:07.647249 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca497d32-aaa6-4f42-9a7d-d196784568d9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:07.690167 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:07.948180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ca497d32-aaa6-4f42-9a7d-d196784568d9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:07.962420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ca497d32-aaa6-4f42-9a7d-d196784568d9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1264 microversion: 2.1 time: 0.359165 Aug 30 01:20:07.963646 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 175/354] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:07 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1264 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:08.214771 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-73aa1338-f76f-495b-ae9c-90ee62f3d737 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:08.219892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-73aa1338-f76f-495b-ae9c-90ee62f3d737 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:08.247401 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73aa1338-f76f-495b-ae9c-90ee62f3d737 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:08.248289 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73aa1338-f76f-495b-ae9c-90ee62f3d737 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:08.249040 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73aa1338-f76f-495b-ae9c-90ee62f3d737 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:08.250127 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73aa1338-f76f-495b-ae9c-90ee62f3d737 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:08.252633 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73aa1338-f76f-495b-ae9c-90ee62f3d737 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:08.253555 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73aa1338-f76f-495b-ae9c-90ee62f3d737 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:08.535327 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-53048135-561f-4275-8347-7aa7710c6165 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:08.535971 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-53048135-561f-4275-8347-7aa7710c6165 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:08.549195 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53048135-561f-4275-8347-7aa7710c6165 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:08.549693 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53048135-561f-4275-8347-7aa7710c6165 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:08.550178 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53048135-561f-4275-8347-7aa7710c6165 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:08.550890 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53048135-561f-4275-8347-7aa7710c6165 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:08.551335 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53048135-561f-4275-8347-7aa7710c6165 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:08.556481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53048135-561f-4275-8347-7aa7710c6165 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:08.580860 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-73aa1338-f76f-495b-ae9c-90ee62f3d737 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:08.594237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-73aa1338-f76f-495b-ae9c-90ee62f3d737 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1506 microversion: 2.1 time: 0.392558 Aug 30 01:20:08.597727 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 180/355] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:08 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:08.631312 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-828d5305-f2c1-4b89-a5c8-f87bc48dce3a tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91ed8dc1-44fc-40ec-99b0-f0292f965c57", "device": "/dev/sdb"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:08.636332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-828d5305-f2c1-4b89-a5c8-f87bc48dce3a tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:08.650018 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-828d5305-f2c1-4b89-a5c8-f87bc48dce3a tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:08.655859 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-828d5305-f2c1-4b89-a5c8-f87bc48dce3a tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:08.656647 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-828d5305-f2c1-4b89-a5c8-f87bc48dce3a tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:08.657566 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-828d5305-f2c1-4b89-a5c8-f87bc48dce3a tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:08.661039 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-828d5305-f2c1-4b89-a5c8-f87bc48dce3a tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:08.662275 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-828d5305-f2c1-4b89-a5c8-f87bc48dce3a tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:08.904450 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-53048135-561f-4275-8347-7aa7710c6165 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:08.920655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-53048135-561f-4275-8347-7aa7710c6165 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1677 microversion: 2.1 time: 0.389435 Aug 30 01:20:08.921534 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 176/356] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:08 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1677 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:08.985917 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-69fb16a7-22b2-41be-a0ee-d7938162c5d3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:08.986904 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-69fb16a7-22b2-41be-a0ee-d7938162c5d3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:09.003125 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-69fb16a7-22b2-41be-a0ee-d7938162c5d3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:09.008655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-69fb16a7-22b2-41be-a0ee-d7938162c5d3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:09.010017 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-69fb16a7-22b2-41be-a0ee-d7938162c5d3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:09.011394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-69fb16a7-22b2-41be-a0ee-d7938162c5d3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:09.012111 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-69fb16a7-22b2-41be-a0ee-d7938162c5d3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:09.015814 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-69fb16a7-22b2-41be-a0ee-d7938162c5d3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:09.338131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-828d5305-f2c1-4b89-a5c8-f87bc48dce3a tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "POST /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.712926 Aug 30 01:20:09.361031 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 181/357] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:20:08 2022] POST /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1/os-volume_attachments => generated 194 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:20:09.440955 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-69fb16a7-22b2-41be-a0ee-d7938162c5d3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:09.500298 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-69fb16a7-22b2-41be-a0ee-d7938162c5d3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1264 microversion: 2.1 time: 0.518803 Aug 30 01:20:09.505745 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 177/358] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:08 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1264 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:09.949397 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ef3979b5-01e9-49f4-8552-7f3cdc027b8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:09.952645 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ef3979b5-01e9-49f4-8552-7f3cdc027b8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:09.971106 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef3979b5-01e9-49f4-8552-7f3cdc027b8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:09.971937 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef3979b5-01e9-49f4-8552-7f3cdc027b8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:09.972593 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef3979b5-01e9-49f4-8552-7f3cdc027b8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:09.973557 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef3979b5-01e9-49f4-8552-7f3cdc027b8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:09.974541 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef3979b5-01e9-49f4-8552-7f3cdc027b8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:09.976244 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef3979b5-01e9-49f4-8552-7f3cdc027b8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:10.262501 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ef3979b5-01e9-49f4-8552-7f3cdc027b8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:10.273099 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ef3979b5-01e9-49f4-8552-7f3cdc027b8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1677 microversion: 2.1 time: 0.329175 Aug 30 01:20:10.279079 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 182/359] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:09 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1677 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:10.539881 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7c8ebdbf-adf9-49a5-bdb5-132e30066184 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:10.541142 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7c8ebdbf-adf9-49a5-bdb5-132e30066184 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:10.548889 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c8ebdbf-adf9-49a5-bdb5-132e30066184 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:10.549695 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c8ebdbf-adf9-49a5-bdb5-132e30066184 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:10.550287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c8ebdbf-adf9-49a5-bdb5-132e30066184 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:10.551196 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c8ebdbf-adf9-49a5-bdb5-132e30066184 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:10.552348 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c8ebdbf-adf9-49a5-bdb5-132e30066184 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:10.552984 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c8ebdbf-adf9-49a5-bdb5-132e30066184 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:10.822947 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7c8ebdbf-adf9-49a5-bdb5-132e30066184 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:10.833569 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7c8ebdbf-adf9-49a5-bdb5-132e30066184 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1264 microversion: 2.1 time: 0.297652 Aug 30 01:20:10.847101 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 178/360] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:10 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1264 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:11.316347 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4ebb712c-2c42-4968-9d68-b34331411d70 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:11.317027 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4ebb712c-2c42-4968-9d68-b34331411d70 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:11.324055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ebb712c-2c42-4968-9d68-b34331411d70 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:11.324520 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ebb712c-2c42-4968-9d68-b34331411d70 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:11.324954 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ebb712c-2c42-4968-9d68-b34331411d70 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:11.325660 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ebb712c-2c42-4968-9d68-b34331411d70 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:11.326118 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ebb712c-2c42-4968-9d68-b34331411d70 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:11.326543 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ebb712c-2c42-4968-9d68-b34331411d70 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:11.582106 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4ebb712c-2c42-4968-9d68-b34331411d70 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:11.591495 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4ebb712c-2c42-4968-9d68-b34331411d70 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1677 microversion: 2.1 time: 0.279236 Aug 30 01:20:11.592460 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 183/361] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:11 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1677 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:11.859184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f8a0e22f-5b63-49df-ba2f-306bc91ee23a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:11.861554 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f8a0e22f-5b63-49df-ba2f-306bc91ee23a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:11.875617 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8a0e22f-5b63-49df-ba2f-306bc91ee23a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:11.877001 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8a0e22f-5b63-49df-ba2f-306bc91ee23a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:11.878040 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8a0e22f-5b63-49df-ba2f-306bc91ee23a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:11.879949 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8a0e22f-5b63-49df-ba2f-306bc91ee23a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:11.881408 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8a0e22f-5b63-49df-ba2f-306bc91ee23a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:11.882292 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8a0e22f-5b63-49df-ba2f-306bc91ee23a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:12.115783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f8a0e22f-5b63-49df-ba2f-306bc91ee23a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:12.129680 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f8a0e22f-5b63-49df-ba2f-306bc91ee23a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1264 microversion: 2.1 time: 0.277893 Aug 30 01:20:12.131066 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 179/362] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:11 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1264 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:12.635923 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e1f64007-3998-44b7-8ca9-f7c5327b1003 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:12.637340 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e1f64007-3998-44b7-8ca9-f7c5327b1003 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:12.644958 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e1f64007-3998-44b7-8ca9-f7c5327b1003 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:12.647031 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e1f64007-3998-44b7-8ca9-f7c5327b1003 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:12.647930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e1f64007-3998-44b7-8ca9-f7c5327b1003 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:12.648960 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e1f64007-3998-44b7-8ca9-f7c5327b1003 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:12.649646 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e1f64007-3998-44b7-8ca9-f7c5327b1003 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:12.650319 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e1f64007-3998-44b7-8ca9-f7c5327b1003 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:12.884168 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e1f64007-3998-44b7-8ca9-f7c5327b1003 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:12.899363 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e1f64007-3998-44b7-8ca9-f7c5327b1003 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1677 microversion: 2.1 time: 0.267344 Aug 30 01:20:12.913915 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 184/363] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:12 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1677 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:13.152362 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-46bc6733-029d-4a86-974f-8bad294b54f6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:13.153282 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-46bc6733-029d-4a86-974f-8bad294b54f6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:13.160085 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-46bc6733-029d-4a86-974f-8bad294b54f6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:13.160588 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-46bc6733-029d-4a86-974f-8bad294b54f6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:13.161646 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-46bc6733-029d-4a86-974f-8bad294b54f6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:13.162361 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-46bc6733-029d-4a86-974f-8bad294b54f6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:13.162820 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-46bc6733-029d-4a86-974f-8bad294b54f6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:13.163243 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-46bc6733-029d-4a86-974f-8bad294b54f6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:13.341595 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-46bc6733-029d-4a86-974f-8bad294b54f6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:13.354670 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-46bc6733-029d-4a86-974f-8bad294b54f6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1264 microversion: 2.1 time: 0.206332 Aug 30 01:20:13.359923 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 180/364] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:13 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:13.833428 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-dd837b7b-d2c0-4244-98a1-f50a2dc30505 req-de67a21c-d582-41c1-ba5c-8d4792f9e87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "806ac720-5f83-41ac-8053-3debfda5295d", "name": "network-vif-plugged", "status": "completed", "tag": "f8872fed-3b35-451c-ae5b-1a2e7790acd0"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:13.854287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e824140b-1ef1-413b-90c0-a223a3eb2dc3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:13.857926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e824140b-1ef1-413b-90c0-a223a3eb2dc3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:13.867060 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-dd837b7b-d2c0-4244-98a1-f50a2dc30505 req-de67a21c-d582-41c1-ba5c-8d4792f9e87c service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:13.870714 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-dd837b7b-d2c0-4244-98a1-f50a2dc30505 req-de67a21c-d582-41c1-ba5c-8d4792f9e87c service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:13.871549 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-dd837b7b-d2c0-4244-98a1-f50a2dc30505 req-de67a21c-d582-41c1-ba5c-8d4792f9e87c service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:13.876367 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e824140b-1ef1-413b-90c0-a223a3eb2dc3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:13.877212 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e824140b-1ef1-413b-90c0-a223a3eb2dc3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:13.880935 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e824140b-1ef1-413b-90c0-a223a3eb2dc3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:13.882118 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e824140b-1ef1-413b-90c0-a223a3eb2dc3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:13.882918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e824140b-1ef1-413b-90c0-a223a3eb2dc3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:13.884630 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e824140b-1ef1-413b-90c0-a223a3eb2dc3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:13.918939 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-dd837b7b-d2c0-4244-98a1-f50a2dc30505 req-de67a21c-d582-41c1-ba5c-8d4792f9e87c service nova] Creating event network-vif-plugged:f8872fed-3b35-451c-ae5b-1a2e7790acd0 for instance 806ac720-5f83-41ac-8053-3debfda5295d on hv-cinder-81514 Aug 30 01:20:13.932954 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-dd837b7b-d2c0-4244-98a1-f50a2dc30505 req-de67a21c-d582-41c1-ba5c-8d4792f9e87c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104942 Aug 30 01:20:13.936726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 185/365] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:13.948035 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8a271015-ab67-4139-961c-6eaa2e394d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:13.952429 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8a271015-ab67-4139-961c-6eaa2e394d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:13.963689 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a271015-ab67-4139-961c-6eaa2e394d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:13.967437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-e824140b-1ef1-413b-90c0-a223a3eb2dc3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lazy-loading 'flavor' on Instance uuid 9f6ce1c9-bac7-4653-8051-123c152ed7df {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:20:13.971588 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a271015-ab67-4139-961c-6eaa2e394d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:13.972420 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a271015-ab67-4139-961c-6eaa2e394d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:13.974100 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a271015-ab67-4139-961c-6eaa2e394d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:13.974435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a271015-ab67-4139-961c-6eaa2e394d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:13.975029 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a271015-ab67-4139-961c-6eaa2e394d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:14.227139 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e824140b-1ef1-413b-90c0-a223a3eb2dc3 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "POST /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/action" status: 200 len: 32 microversion: 2.1 time: 0.380183 Aug 30 01:20:14.228107 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 181/366] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:20:13 2022] POST /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/action => generated 32 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:20:14.239336 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c435052c-7820-487c-a8e0-710e40f45422 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:14.240792 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c435052c-7820-487c-a8e0-710e40f45422 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:14.248067 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c435052c-7820-487c-a8e0-710e40f45422 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:14.248678 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c435052c-7820-487c-a8e0-710e40f45422 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:14.249228 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c435052c-7820-487c-a8e0-710e40f45422 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:14.250053 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c435052c-7820-487c-a8e0-710e40f45422 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:14.250762 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c435052c-7820-487c-a8e0-710e40f45422 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:14.251296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c435052c-7820-487c-a8e0-710e40f45422 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:14.296641 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8a271015-ab67-4139-961c-6eaa2e394d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:14.325464 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8a271015-ab67-4139-961c-6eaa2e394d54 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1677 microversion: 2.1 time: 0.386766 Aug 30 01:20:14.326916 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 186/367] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:13 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1677 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:14.405612 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8cfb5713-f072-4a4e-9afb-c4874e056ee9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:14.407538 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8cfb5713-f072-4a4e-9afb-c4874e056ee9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:14.434604 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8cfb5713-f072-4a4e-9afb-c4874e056ee9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:14.435520 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8cfb5713-f072-4a4e-9afb-c4874e056ee9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:14.436406 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8cfb5713-f072-4a4e-9afb-c4874e056ee9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:14.437947 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8cfb5713-f072-4a4e-9afb-c4874e056ee9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:14.439988 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8cfb5713-f072-4a4e-9afb-c4874e056ee9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:14.440834 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8cfb5713-f072-4a4e-9afb-c4874e056ee9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:14.484233 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:14.507118 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c435052c-7820-487c-a8e0-710e40f45422 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:14.534780 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c435052c-7820-487c-a8e0-710e40f45422 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.300118 Aug 30 01:20:14.536588 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 182/368] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:14 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:14.761861 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8cfb5713-f072-4a4e-9afb-c4874e056ee9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:14.773755 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8cfb5713-f072-4a4e-9afb-c4874e056ee9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1264 microversion: 2.1 time: 0.384586 Aug 30 01:20:14.775039 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 187/369] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:14 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1264 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:15.373127 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-291ed6db-8442-4d21-9fd6-d12ea5af80d3 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:15.375030 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-291ed6db-8442-4d21-9fd6-d12ea5af80d3 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:15.385821 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-291ed6db-8442-4d21-9fd6-d12ea5af80d3 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:15.387498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-291ed6db-8442-4d21-9fd6-d12ea5af80d3 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:15.388559 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-291ed6db-8442-4d21-9fd6-d12ea5af80d3 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:15.390046 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-291ed6db-8442-4d21-9fd6-d12ea5af80d3 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:15.391151 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-291ed6db-8442-4d21-9fd6-d12ea5af80d3 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:15.418881 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-291ed6db-8442-4d21-9fd6-d12ea5af80d3 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:15.568632 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-489a06f5-c8c9-4d94-8429-f015f887bb2d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:15.570451 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-489a06f5-c8c9-4d94-8429-f015f887bb2d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:15.585466 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-489a06f5-c8c9-4d94-8429-f015f887bb2d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:15.586394 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-489a06f5-c8c9-4d94-8429-f015f887bb2d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:15.586394 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-489a06f5-c8c9-4d94-8429-f015f887bb2d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:15.587086 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-489a06f5-c8c9-4d94-8429-f015f887bb2d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:15.587602 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-489a06f5-c8c9-4d94-8429-f015f887bb2d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:15.588041 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-489a06f5-c8c9-4d94-8429-f015f887bb2d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:15.693034 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-291ed6db-8442-4d21-9fd6-d12ea5af80d3 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:15.707056 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-291ed6db-8442-4d21-9fd6-d12ea5af80d3 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1677 microversion: 2.1 time: 0.337689 Aug 30 01:20:15.709008 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 183/370] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:15 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1677 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:15.807968 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9c231ab2-9aec-4c4e-bacd-89a64ff19fef tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:15.811142 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9c231ab2-9aec-4c4e-bacd-89a64ff19fef tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:15.817599 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9c231ab2-9aec-4c4e-bacd-89a64ff19fef tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:15.818266 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9c231ab2-9aec-4c4e-bacd-89a64ff19fef tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:15.818776 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9c231ab2-9aec-4c4e-bacd-89a64ff19fef tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:15.819642 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9c231ab2-9aec-4c4e-bacd-89a64ff19fef tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:15.820415 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9c231ab2-9aec-4c4e-bacd-89a64ff19fef tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:15.820933 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9c231ab2-9aec-4c4e-bacd-89a64ff19fef tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:15.824603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-489a06f5-c8c9-4d94-8429-f015f887bb2d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:15.841243 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-489a06f5-c8c9-4d94-8429-f015f887bb2d tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.280326 Aug 30 01:20:15.843179 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 188/371] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:15 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:16.095225 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9c231ab2-9aec-4c4e-bacd-89a64ff19fef tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:16.109158 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9c231ab2-9aec-4c4e-bacd-89a64ff19fef tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1264 microversion: 2.1 time: 0.305209 Aug 30 01:20:16.109752 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 184/372] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:15 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1264 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:16.736011 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-73bd9955-7dd5-4465-9ac9-4bd0ea09af37 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:16.736847 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-73bd9955-7dd5-4465-9ac9-4bd0ea09af37 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:16.745575 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73bd9955-7dd5-4465-9ac9-4bd0ea09af37 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:16.746098 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73bd9955-7dd5-4465-9ac9-4bd0ea09af37 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:16.746544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73bd9955-7dd5-4465-9ac9-4bd0ea09af37 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:16.747248 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73bd9955-7dd5-4465-9ac9-4bd0ea09af37 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:16.747705 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73bd9955-7dd5-4465-9ac9-4bd0ea09af37 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:16.748173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73bd9955-7dd5-4465-9ac9-4bd0ea09af37 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:16.869700 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-81db33c9-7039-4bad-b499-6f80fa99fb74 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:16.871241 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-81db33c9-7039-4bad-b499-6f80fa99fb74 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:16.883804 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81db33c9-7039-4bad-b499-6f80fa99fb74 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:16.884654 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81db33c9-7039-4bad-b499-6f80fa99fb74 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:16.885284 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81db33c9-7039-4bad-b499-6f80fa99fb74 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:16.886208 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81db33c9-7039-4bad-b499-6f80fa99fb74 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:16.886854 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81db33c9-7039-4bad-b499-6f80fa99fb74 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:16.887293 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81db33c9-7039-4bad-b499-6f80fa99fb74 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:16.922643 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-73bd9955-7dd5-4465-9ac9-4bd0ea09af37 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:16.935488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-73bd9955-7dd5-4465-9ac9-4bd0ea09af37 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1677 microversion: 2.1 time: 0.205709 Aug 30 01:20:16.953069 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 189/373] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:16 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:17.095833 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-81db33c9-7039-4bad-b499-6f80fa99fb74 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:17.106488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-81db33c9-7039-4bad-b499-6f80fa99fb74 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.245229 Aug 30 01:20:17.107186 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 185/374] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:16 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:17.134450 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-92f8687a-52b5-4d8a-b72c-b0fc57ab889c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:17.135358 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-92f8687a-52b5-4d8a-b72c-b0fc57ab889c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:17.148444 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-92f8687a-52b5-4d8a-b72c-b0fc57ab889c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:17.149274 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-92f8687a-52b5-4d8a-b72c-b0fc57ab889c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:17.150044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-92f8687a-52b5-4d8a-b72c-b0fc57ab889c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:17.150907 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-92f8687a-52b5-4d8a-b72c-b0fc57ab889c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:17.151413 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-92f8687a-52b5-4d8a-b72c-b0fc57ab889c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:17.152550 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-92f8687a-52b5-4d8a-b72c-b0fc57ab889c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:17.296771 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-01990e8c-69aa-4fdd-a03e-9f43b3ad9df9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Action: 'create', calling method: .version_select at 0x7ff48b24e280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-259051794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5lYCJsxnk01eCXCS1A55NXwMskwhovJmmYbi/IFyFgHgspUZA4bK0GbHJLt7772/mOJNJSCIAxcqm4Pnguap5kwohkL9PKE0+Hn077DDitB5b75aLRRMrq9mq21ZiL2w=="}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:17.305377 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-92f8687a-52b5-4d8a-b72c-b0fc57ab889c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:17.313791 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-92f8687a-52b5-4d8a-b72c-b0fc57ab889c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1451 microversion: 2.1 time: 0.186711 Aug 30 01:20:17.314061 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-01990e8c-69aa-4fdd-a03e-9f43b3ad9df9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Getting quotas for project 91f4e4df4e2744bfb9fcd84431ed567e. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:20:17.314377 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 190/375] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:17 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1451 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:17.319202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-01990e8c-69aa-4fdd-a03e-9f43b3ad9df9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Getting quotas for user a21183e645d74e4f9378c650e7916ba8 and project 91f4e4df4e2744bfb9fcd84431ed567e. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:20:17.338738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f5c0f921-a643-4390-b47d-4d0aece44408 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:17.339388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f5c0f921-a643-4390-b47d-4d0aece44408 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:17.349245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-01990e8c-69aa-4fdd-a03e-9f43b3ad9df9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056196 Aug 30 01:20:17.349555 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f5c0f921-a643-4390-b47d-4d0aece44408 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:17.350342 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f5c0f921-a643-4390-b47d-4d0aece44408 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:17.350462 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 186/376] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Aug 30 01:20:17 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:17.350564 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f5c0f921-a643-4390-b47d-4d0aece44408 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:17.351265 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f5c0f921-a643-4390-b47d-4d0aece44408 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:17.351730 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f5c0f921-a643-4390-b47d-4d0aece44408 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:17.352188 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f5c0f921-a643-4390-b47d-4d0aece44408 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:17.474359 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-563303722", "imageRef": "788ef42d-e566-4842-b4a4-95852bc2b6fb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-259051794", "networks": [{"uuid": "5ce0c305-01fc-449d-b0c0-4088efbdda38"}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:17.520105 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f5c0f921-a643-4390-b47d-4d0aece44408 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:17.529848 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f5c0f921-a643-4390-b47d-4d0aece44408 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1451 microversion: 2.1 time: 0.196253 Aug 30 01:20:17.530452 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 191/377] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:17 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1451 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:17.536548 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] validate_networks() for [('5ce0c305-01fc-449d-b0c0-4088efbdda38', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:20:17.970003 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-11b4b77f-dac9-463c-9d50-4cae5831ed8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:17.971562 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-11b4b77f-dac9-463c-9d50-4cae5831ed8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:17.979252 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-11b4b77f-dac9-463c-9d50-4cae5831ed8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:17.979737 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-11b4b77f-dac9-463c-9d50-4cae5831ed8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:17.980428 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-11b4b77f-dac9-463c-9d50-4cae5831ed8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:17.981339 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-11b4b77f-dac9-463c-9d50-4cae5831ed8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:17.981989 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-11b4b77f-dac9-463c-9d50-4cae5831ed8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:17.982408 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-11b4b77f-dac9-463c-9d50-4cae5831ed8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:18.026593 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:20:18.027295 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:20:18.027821 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:20:18.028416 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:20:18.028837 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:20:18.038725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:18.039217 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:18.039659 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:18.040436 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:18.040940 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:18.041576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:18.062384 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Getting quotas for project 91f4e4df4e2744bfb9fcd84431ed567e. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:20:18.073733 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Getting quotas for user a21183e645d74e4f9378c650e7916ba8 and project 91f4e4df4e2744bfb9fcd84431ed567e. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:20:18.089709 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:20:18.093354 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='788ef42d-e566-4842-b4a4-95852bc2b6fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:20:18.153726 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6bad5108-5bf8-42d7-a5b2-dfd04791762c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683096 Aug 30 01:20:18.154605 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 187/378] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:20:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:20:18.162013 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b904921e-a045-4359-a611-eb5b6f056b29 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:18.162724 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b904921e-a045-4359-a611-eb5b6f056b29 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:18.170292 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b904921e-a045-4359-a611-eb5b6f056b29 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:18.170889 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b904921e-a045-4359-a611-eb5b6f056b29 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:18.171398 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b904921e-a045-4359-a611-eb5b6f056b29 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:18.173159 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b904921e-a045-4359-a611-eb5b6f056b29 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:18.173733 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b904921e-a045-4359-a611-eb5b6f056b29 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:18.174237 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b904921e-a045-4359-a611-eb5b6f056b29 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:18.243022 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-11b4b77f-dac9-463c-9d50-4cae5831ed8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:18.257560 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-11b4b77f-dac9-463c-9d50-4cae5831ed8e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1654 microversion: 2.1 time: 0.292330 Aug 30 01:20:18.258250 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 192/379] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:17 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1654 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:18.262991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d9e26223-9fe7-4de4-8b7c-0b8091d8ae0f tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:18.263580 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d9e26223-9fe7-4de4-8b7c-0b8091d8ae0f tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:18.361292 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d9e26223-9fe7-4de4-8b7c-0b8091d8ae0f tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:18.373054 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d9e26223-9fe7-4de4-8b7c-0b8091d8ae0f tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1257 microversion: 2.1 time: 0.113332 Aug 30 01:20:18.373807 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 193/380] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:18 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1257 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:18.382253 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-23eb167d-b389-4766-aeb6-6f6ff5bec68e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:18.401208 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23eb167d-b389-4766-aeb6-6f6ff5bec68e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:18.402916 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23eb167d-b389-4766-aeb6-6f6ff5bec68e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:18.403831 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23eb167d-b389-4766-aeb6-6f6ff5bec68e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:18.424261 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b904921e-a045-4359-a611-eb5b6f056b29 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:18.449710 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b904921e-a045-4359-a611-eb5b6f056b29 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.291666 Aug 30 01:20:18.452122 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 188/381] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:18 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:18.486846 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-23eb167d-b389-4766-aeb6-6f6ff5bec68e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Going to try to start instance {{(pid=120705) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 01:20:18.554662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-23eb167d-b389-4766-aeb6-6f6ff5bec68e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "POST /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/action" status: 202 len: 0 microversion: 2.1 time: 0.177304 Aug 30 01:20:18.556244 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 194/382] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:20:18 2022] POST /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:20:18.571492 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2329eb44-c323-42fa-bae7-30a4d2b88bbd tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:18.572906 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2329eb44-c323-42fa-bae7-30a4d2b88bbd tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:18.585770 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2329eb44-c323-42fa-bae7-30a4d2b88bbd tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:18.587408 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2329eb44-c323-42fa-bae7-30a4d2b88bbd tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:18.587408 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2329eb44-c323-42fa-bae7-30a4d2b88bbd tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:18.588716 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2329eb44-c323-42fa-bae7-30a4d2b88bbd tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:18.589549 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2329eb44-c323-42fa-bae7-30a4d2b88bbd tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:18.591043 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2329eb44-c323-42fa-bae7-30a4d2b88bbd tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:18.797700 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2329eb44-c323-42fa-bae7-30a4d2b88bbd tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:18.808461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2329eb44-c323-42fa-bae7-30a4d2b88bbd tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1663 microversion: 2.1 time: 0.246429 Aug 30 01:20:18.809263 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 189/383] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:18 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1663 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:19.405698 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-26cfe683-f408-4e81-9c5b-cf69e495e8bb tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:19.406420 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-26cfe683-f408-4e81-9c5b-cf69e495e8bb tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:19.415776 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26cfe683-f408-4e81-9c5b-cf69e495e8bb tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:19.416432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26cfe683-f408-4e81-9c5b-cf69e495e8bb tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:19.417118 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26cfe683-f408-4e81-9c5b-cf69e495e8bb tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:19.417924 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26cfe683-f408-4e81-9c5b-cf69e495e8bb tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:19.418521 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26cfe683-f408-4e81-9c5b-cf69e495e8bb tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:19.419235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26cfe683-f408-4e81-9c5b-cf69e495e8bb tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:19.491268 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1b02dcab-3e8a-4e31-bd1f-1b6a95fbfc97 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:19.491878 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1b02dcab-3e8a-4e31-bd1f-1b6a95fbfc97 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:19.500093 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b02dcab-3e8a-4e31-bd1f-1b6a95fbfc97 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:19.500900 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b02dcab-3e8a-4e31-bd1f-1b6a95fbfc97 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:19.501589 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b02dcab-3e8a-4e31-bd1f-1b6a95fbfc97 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:19.501860 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b02dcab-3e8a-4e31-bd1f-1b6a95fbfc97 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:19.502311 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b02dcab-3e8a-4e31-bd1f-1b6a95fbfc97 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:19.502760 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b02dcab-3e8a-4e31-bd1f-1b6a95fbfc97 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:19.541647 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-26cfe683-f408-4e81-9c5b-cf69e495e8bb tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:19.554719 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-26cfe683-f408-4e81-9c5b-cf69e495e8bb tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1309 microversion: 2.1 time: 0.155483 Aug 30 01:20:19.555601 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 195/384] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:19 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1309 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:19.659320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1b02dcab-3e8a-4e31-bd1f-1b6a95fbfc97 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:19.668982 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1b02dcab-3e8a-4e31-bd1f-1b6a95fbfc97 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.184478 Aug 30 01:20:19.669750 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 190/385] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:19 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:19.829982 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-42f7ab33-d3e8-4f9a-b491-e13a990bba90 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:19.830600 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-42f7ab33-d3e8-4f9a-b491-e13a990bba90 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:19.837433 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-42f7ab33-d3e8-4f9a-b491-e13a990bba90 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:19.837929 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-42f7ab33-d3e8-4f9a-b491-e13a990bba90 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:19.838372 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-42f7ab33-d3e8-4f9a-b491-e13a990bba90 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:19.839076 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-42f7ab33-d3e8-4f9a-b491-e13a990bba90 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:19.839732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-42f7ab33-d3e8-4f9a-b491-e13a990bba90 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:19.840194 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-42f7ab33-d3e8-4f9a-b491-e13a990bba90 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:20.287021 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-42f7ab33-d3e8-4f9a-b491-e13a990bba90 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:20.296744 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-42f7ab33-d3e8-4f9a-b491-e13a990bba90 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1663 microversion: 2.1 time: 0.469866 Aug 30 01:20:20.296744 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 196/386] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:19 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1663 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:20.576788 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4580edff-53af-4003-86ff-b20dab7ca087 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:20.577828 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4580edff-53af-4003-86ff-b20dab7ca087 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:20.585527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4580edff-53af-4003-86ff-b20dab7ca087 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:20.586026 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4580edff-53af-4003-86ff-b20dab7ca087 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:20.586476 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4580edff-53af-4003-86ff-b20dab7ca087 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:20.587196 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4580edff-53af-4003-86ff-b20dab7ca087 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:20.587662 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4580edff-53af-4003-86ff-b20dab7ca087 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:20.588139 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4580edff-53af-4003-86ff-b20dab7ca087 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:20.681955 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4580edff-53af-4003-86ff-b20dab7ca087 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:20.696862 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:20.697533 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-df719aa1-93e7-4f21-bb6c-c3d2ff4755bf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:20.698918 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-df719aa1-93e7-4f21-bb6c-c3d2ff4755bf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:20.712397 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df719aa1-93e7-4f21-bb6c-c3d2ff4755bf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:20.713254 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df719aa1-93e7-4f21-bb6c-c3d2ff4755bf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:20.714732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df719aa1-93e7-4f21-bb6c-c3d2ff4755bf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:20.715484 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df719aa1-93e7-4f21-bb6c-c3d2ff4755bf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:20.715946 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df719aa1-93e7-4f21-bb6c-c3d2ff4755bf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:20.717860 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df719aa1-93e7-4f21-bb6c-c3d2ff4755bf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:20.720503 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4580edff-53af-4003-86ff-b20dab7ca087 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1309 microversion: 2.1 time: 0.145650 Aug 30 01:20:20.721891 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 191/387] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:20 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1309 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:20.773062 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-605de402-ff27-4c17-a287-ce8e7e0ce131 req-d8b367d4-cd38-4a29-bc7c-fc2c5c2de09e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "806ac720-5f83-41ac-8053-3debfda5295d", "tag": "f8872fed-3b35-451c-ae5b-1a2e7790acd0"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:20.792938 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-605de402-ff27-4c17-a287-ce8e7e0ce131 req-d8b367d4-cd38-4a29-bc7c-fc2c5c2de09e service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:20.793432 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-605de402-ff27-4c17-a287-ce8e7e0ce131 req-d8b367d4-cd38-4a29-bc7c-fc2c5c2de09e service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:20.793927 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-605de402-ff27-4c17-a287-ce8e7e0ce131 req-d8b367d4-cd38-4a29-bc7c-fc2c5c2de09e service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:20.813234 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-605de402-ff27-4c17-a287-ce8e7e0ce131 req-d8b367d4-cd38-4a29-bc7c-fc2c5c2de09e service nova] Creating event network-changed:f8872fed-3b35-451c-ae5b-1a2e7790acd0 for instance 806ac720-5f83-41ac-8053-3debfda5295d on hv-cinder-81514 Aug 30 01:20:20.821312 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-605de402-ff27-4c17-a287-ce8e7e0ce131 req-d8b367d4-cd38-4a29-bc7c-fc2c5c2de09e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063329 Aug 30 01:20:20.822357 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 192/388] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:20:21.010973 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-df719aa1-93e7-4f21-bb6c-c3d2ff4755bf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:21.041608 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-df719aa1-93e7-4f21-bb6c-c3d2ff4755bf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.351732 Aug 30 01:20:21.044502 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 197/389] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:20 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:21.320279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-eff053fd-6a53-4639-b496-f487a372b463 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:21.321187 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-eff053fd-6a53-4639-b496-f487a372b463 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:21.328321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eff053fd-6a53-4639-b496-f487a372b463 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:21.328954 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eff053fd-6a53-4639-b496-f487a372b463 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:21.329501 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eff053fd-6a53-4639-b496-f487a372b463 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:21.330357 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eff053fd-6a53-4639-b496-f487a372b463 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:21.330922 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eff053fd-6a53-4639-b496-f487a372b463 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:21.331456 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eff053fd-6a53-4639-b496-f487a372b463 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:21.591226 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-eff053fd-6a53-4639-b496-f487a372b463 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:21.606657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-eff053fd-6a53-4639-b496-f487a372b463 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1663 microversion: 2.1 time: 0.292371 Aug 30 01:20:21.621444 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 193/390] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:21 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1663 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:21.757002 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-17686849-d970-4404-a126-77bf7200c43d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:21.758605 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-17686849-d970-4404-a126-77bf7200c43d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:21.765367 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17686849-d970-4404-a126-77bf7200c43d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:21.765952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17686849-d970-4404-a126-77bf7200c43d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:21.766462 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17686849-d970-4404-a126-77bf7200c43d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:21.767186 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17686849-d970-4404-a126-77bf7200c43d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:21.767909 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17686849-d970-4404-a126-77bf7200c43d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:21.768557 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17686849-d970-4404-a126-77bf7200c43d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:21.882559 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-17686849-d970-4404-a126-77bf7200c43d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:21.890008 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-17686849-d970-4404-a126-77bf7200c43d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1315 microversion: 2.1 time: 0.138835 Aug 30 01:20:21.903579 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 198/391] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:21 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:22.072326 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-25c3b9de-860f-4d41-ab52-87923934d710 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:22.073469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-25c3b9de-860f-4d41-ab52-87923934d710 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:22.082913 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-25c3b9de-860f-4d41-ab52-87923934d710 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:22.083424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-25c3b9de-860f-4d41-ab52-87923934d710 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:22.083955 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-25c3b9de-860f-4d41-ab52-87923934d710 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:22.084898 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-25c3b9de-860f-4d41-ab52-87923934d710 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:22.085365 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-25c3b9de-860f-4d41-ab52-87923934d710 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:22.085807 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-25c3b9de-860f-4d41-ab52-87923934d710 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:22.260108 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-25c3b9de-860f-4d41-ab52-87923934d710 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:22.271058 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-25c3b9de-860f-4d41-ab52-87923934d710 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.207283 Aug 30 01:20:22.271838 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 194/392] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:22 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:22.631883 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2a04d3f5-1d0c-4adf-80eb-d9993c17c20e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:22.632675 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2a04d3f5-1d0c-4adf-80eb-d9993c17c20e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:22.639057 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a04d3f5-1d0c-4adf-80eb-d9993c17c20e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:22.639535 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a04d3f5-1d0c-4adf-80eb-d9993c17c20e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:22.639963 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a04d3f5-1d0c-4adf-80eb-d9993c17c20e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:22.640687 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a04d3f5-1d0c-4adf-80eb-d9993c17c20e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:22.641137 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a04d3f5-1d0c-4adf-80eb-d9993c17c20e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:22.641549 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a04d3f5-1d0c-4adf-80eb-d9993c17c20e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:22.793056 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2a04d3f5-1d0c-4adf-80eb-d9993c17c20e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:22.803635 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2a04d3f5-1d0c-4adf-80eb-d9993c17c20e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1667 microversion: 2.1 time: 0.176001 Aug 30 01:20:22.804311 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 199/393] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:22 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1667 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:22.911065 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0ffb1689-22b1-48e8-b4fc-956f5ac99806 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:22.911605 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0ffb1689-22b1-48e8-b4fc-956f5ac99806 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:22.918570 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0ffb1689-22b1-48e8-b4fc-956f5ac99806 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:22.919053 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0ffb1689-22b1-48e8-b4fc-956f5ac99806 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:22.919625 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0ffb1689-22b1-48e8-b4fc-956f5ac99806 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:22.920393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0ffb1689-22b1-48e8-b4fc-956f5ac99806 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:22.920946 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0ffb1689-22b1-48e8-b4fc-956f5ac99806 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:22.921382 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0ffb1689-22b1-48e8-b4fc-956f5ac99806 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:22.985736 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0ffb1689-22b1-48e8-b4fc-956f5ac99806 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:22.994418 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0ffb1689-22b1-48e8-b4fc-956f5ac99806 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1315 microversion: 2.1 time: 0.087394 Aug 30 01:20:22.995012 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 195/394] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:22 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1315 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:23.299425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6d50a03b-2680-4f5b-b21c-8665ad2b6813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:23.301164 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6d50a03b-2680-4f5b-b21c-8665ad2b6813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:23.311976 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d50a03b-2680-4f5b-b21c-8665ad2b6813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:23.312949 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d50a03b-2680-4f5b-b21c-8665ad2b6813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:23.313715 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d50a03b-2680-4f5b-b21c-8665ad2b6813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:23.314928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d50a03b-2680-4f5b-b21c-8665ad2b6813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:23.315507 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d50a03b-2680-4f5b-b21c-8665ad2b6813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:23.316811 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d50a03b-2680-4f5b-b21c-8665ad2b6813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:23.479501 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6d50a03b-2680-4f5b-b21c-8665ad2b6813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:23.489769 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6d50a03b-2680-4f5b-b21c-8665ad2b6813 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.197699 Aug 30 01:20:23.504266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 200/395] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:23 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:24.018622 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7f2cbcc9-566e-45cd-9a93-daec5401683c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:24.019394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7f2cbcc9-566e-45cd-9a93-daec5401683c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:24.028589 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f2cbcc9-566e-45cd-9a93-daec5401683c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:24.029460 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f2cbcc9-566e-45cd-9a93-daec5401683c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:24.030186 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f2cbcc9-566e-45cd-9a93-daec5401683c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:24.031370 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f2cbcc9-566e-45cd-9a93-daec5401683c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:24.032195 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f2cbcc9-566e-45cd-9a93-daec5401683c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:24.032898 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f2cbcc9-566e-45cd-9a93-daec5401683c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:24.109976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7f2cbcc9-566e-45cd-9a93-daec5401683c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:24.119366 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7f2cbcc9-566e-45cd-9a93-daec5401683c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1315 microversion: 2.1 time: 0.105005 Aug 30 01:20:24.119959 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 196/396] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:24 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1315 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:24.512297 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a8e13a6d-ddcc-420a-8af5-318eef7ac938 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:24.512961 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a8e13a6d-ddcc-420a-8af5-318eef7ac938 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:24.520639 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8e13a6d-ddcc-420a-8af5-318eef7ac938 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:24.521130 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8e13a6d-ddcc-420a-8af5-318eef7ac938 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:24.521574 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8e13a6d-ddcc-420a-8af5-318eef7ac938 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:24.522289 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8e13a6d-ddcc-420a-8af5-318eef7ac938 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:24.522741 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8e13a6d-ddcc-420a-8af5-318eef7ac938 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:24.523162 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8e13a6d-ddcc-420a-8af5-318eef7ac938 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:24.673630 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a8e13a6d-ddcc-420a-8af5-318eef7ac938 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:24.684166 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a8e13a6d-ddcc-420a-8af5-318eef7ac938 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.175663 Aug 30 01:20:24.684746 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 201/397] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:24 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:25.141949 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6d915179-7e18-4846-8f5a-90410a96907b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:25.142634 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6d915179-7e18-4846-8f5a-90410a96907b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:25.150620 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d915179-7e18-4846-8f5a-90410a96907b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:25.151107 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d915179-7e18-4846-8f5a-90410a96907b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:25.151592 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d915179-7e18-4846-8f5a-90410a96907b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:25.152352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d915179-7e18-4846-8f5a-90410a96907b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:25.152829 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d915179-7e18-4846-8f5a-90410a96907b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:25.153294 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d915179-7e18-4846-8f5a-90410a96907b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:25.221493 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6d915179-7e18-4846-8f5a-90410a96907b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:25.229916 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6d915179-7e18-4846-8f5a-90410a96907b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1315 microversion: 2.1 time: 0.091875 Aug 30 01:20:25.230387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 197/398] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:25 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1315 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:25.705857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6d698520-dcdd-472b-b4cd-8ad82dff313f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:25.707265 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6d698520-dcdd-472b-b4cd-8ad82dff313f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:25.721129 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d698520-dcdd-472b-b4cd-8ad82dff313f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:25.721630 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d698520-dcdd-472b-b4cd-8ad82dff313f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:25.722143 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d698520-dcdd-472b-b4cd-8ad82dff313f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:25.722908 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d698520-dcdd-472b-b4cd-8ad82dff313f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:25.723417 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d698520-dcdd-472b-b4cd-8ad82dff313f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:25.723845 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d698520-dcdd-472b-b4cd-8ad82dff313f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:25.873242 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6d698520-dcdd-472b-b4cd-8ad82dff313f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:25.883286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6d698520-dcdd-472b-b4cd-8ad82dff313f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.181370 Aug 30 01:20:25.884075 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 202/399] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:25 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:26.257006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-57896a8e-5b7d-476c-8112-a7ee9cbb6552 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:26.257006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-57896a8e-5b7d-476c-8112-a7ee9cbb6552 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:26.260106 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-57896a8e-5b7d-476c-8112-a7ee9cbb6552 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:26.261261 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-57896a8e-5b7d-476c-8112-a7ee9cbb6552 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:26.261731 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-57896a8e-5b7d-476c-8112-a7ee9cbb6552 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:26.262483 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-57896a8e-5b7d-476c-8112-a7ee9cbb6552 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:26.263202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-57896a8e-5b7d-476c-8112-a7ee9cbb6552 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:26.263560 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-57896a8e-5b7d-476c-8112-a7ee9cbb6552 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:26.329399 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-57896a8e-5b7d-476c-8112-a7ee9cbb6552 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:26.338857 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-57896a8e-5b7d-476c-8112-a7ee9cbb6552 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1315 microversion: 2.1 time: 0.091809 Aug 30 01:20:26.339674 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 198/400] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:26 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1315 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:26.905935 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d8172e73-ef6a-4ee7-b570-3ddc7db5ee19 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:26.906657 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d8172e73-ef6a-4ee7-b570-3ddc7db5ee19 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:26.913726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d8172e73-ef6a-4ee7-b570-3ddc7db5ee19 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:26.914222 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d8172e73-ef6a-4ee7-b570-3ddc7db5ee19 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:26.914642 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d8172e73-ef6a-4ee7-b570-3ddc7db5ee19 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:26.915383 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d8172e73-ef6a-4ee7-b570-3ddc7db5ee19 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:26.915833 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d8172e73-ef6a-4ee7-b570-3ddc7db5ee19 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:26.916284 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d8172e73-ef6a-4ee7-b570-3ddc7db5ee19 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:27.057692 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d8172e73-ef6a-4ee7-b570-3ddc7db5ee19 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:27.066972 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d8172e73-ef6a-4ee7-b570-3ddc7db5ee19 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.165357 Aug 30 01:20:27.067564 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 203/401] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:26 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:27.364820 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fe0a8b14-e71e-4ce5-8cf7-af19eeeb46ad tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:27.365783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fe0a8b14-e71e-4ce5-8cf7-af19eeeb46ad tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:27.373600 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fe0a8b14-e71e-4ce5-8cf7-af19eeeb46ad tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:27.374356 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fe0a8b14-e71e-4ce5-8cf7-af19eeeb46ad tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:27.374793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fe0a8b14-e71e-4ce5-8cf7-af19eeeb46ad tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:27.375505 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fe0a8b14-e71e-4ce5-8cf7-af19eeeb46ad tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:27.375960 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fe0a8b14-e71e-4ce5-8cf7-af19eeeb46ad tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:27.376412 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fe0a8b14-e71e-4ce5-8cf7-af19eeeb46ad tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:27.436739 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fe0a8b14-e71e-4ce5-8cf7-af19eeeb46ad tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:27.444412 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fe0a8b14-e71e-4ce5-8cf7-af19eeeb46ad tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1315 microversion: 2.1 time: 0.087048 Aug 30 01:20:27.444983 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 199/402] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:27 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1315 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:28.088669 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f838533a-ebde-4891-974d-fa6ba899319b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:28.089304 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f838533a-ebde-4891-974d-fa6ba899319b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:28.095964 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f838533a-ebde-4891-974d-fa6ba899319b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:28.096476 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f838533a-ebde-4891-974d-fa6ba899319b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:28.096906 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f838533a-ebde-4891-974d-fa6ba899319b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:28.097809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f838533a-ebde-4891-974d-fa6ba899319b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:28.098286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f838533a-ebde-4891-974d-fa6ba899319b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:28.098684 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f838533a-ebde-4891-974d-fa6ba899319b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:28.101770 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:28.244374 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f838533a-ebde-4891-974d-fa6ba899319b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:28.254416 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f838533a-ebde-4891-974d-fa6ba899319b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.169563 Aug 30 01:20:28.255012 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 204/403] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:28 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:28.465547 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ee7d42dc-d537-4543-b2b4-ed308561bde9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:28.466412 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ee7d42dc-d537-4543-b2b4-ed308561bde9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:28.468574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:28.469309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=10 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:28.476562 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee7d42dc-d537-4543-b2b4-ed308561bde9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:28.477054 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee7d42dc-d537-4543-b2b4-ed308561bde9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:28.477484 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee7d42dc-d537-4543-b2b4-ed308561bde9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:28.478185 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee7d42dc-d537-4543-b2b4-ed308561bde9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:28.478808 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee7d42dc-d537-4543-b2b4-ed308561bde9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:28.479489 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee7d42dc-d537-4543-b2b4-ed308561bde9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:28.550452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ee7d42dc-d537-4543-b2b4-ed308561bde9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:28.558376 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ee7d42dc-d537-4543-b2b4-ed308561bde9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1315 microversion: 2.1 time: 0.096814 Aug 30 01:20:28.558940 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 200/404] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:28 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1315 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:29.275962 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e5f945c7-8b03-47c9-928a-675c2f910732 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:29.276630 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e5f945c7-8b03-47c9-928a-675c2f910732 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:29.278568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:29.285371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5f945c7-8b03-47c9-928a-675c2f910732 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:29.285923 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5f945c7-8b03-47c9-928a-675c2f910732 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:29.286364 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5f945c7-8b03-47c9-928a-675c2f910732 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:29.287063 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5f945c7-8b03-47c9-928a-675c2f910732 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:29.287519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5f945c7-8b03-47c9-928a-675c2f910732 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:29.287945 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5f945c7-8b03-47c9-928a-675c2f910732 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:29.487965 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e5f945c7-8b03-47c9-928a-675c2f910732 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:29.496794 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e5f945c7-8b03-47c9-928a-675c2f910732 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.224614 Aug 30 01:20:29.497469 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 205/405] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:29 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:29.578723 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f6b8f455-e1a8-4f79-aeaf-a19014c17f8e tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:29.579331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f6b8f455-e1a8-4f79-aeaf-a19014c17f8e tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:29.585968 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6b8f455-e1a8-4f79-aeaf-a19014c17f8e tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:29.586706 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6b8f455-e1a8-4f79-aeaf-a19014c17f8e tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:29.587304 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6b8f455-e1a8-4f79-aeaf-a19014c17f8e tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:29.588011 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6b8f455-e1a8-4f79-aeaf-a19014c17f8e tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:29.588472 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6b8f455-e1a8-4f79-aeaf-a19014c17f8e tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:29.588887 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6b8f455-e1a8-4f79-aeaf-a19014c17f8e tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:29.656611 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f6b8f455-e1a8-4f79-aeaf-a19014c17f8e tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:29.665302 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f6b8f455-e1a8-4f79-aeaf-a19014c17f8e tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1315 microversion: 2.1 time: 0.090435 Aug 30 01:20:29.665879 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 201/406] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:29 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1315 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:30.519857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-45428e86-d03f-4c41-8094-b8fd37099b8b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:30.520499 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-45428e86-d03f-4c41-8094-b8fd37099b8b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:30.522855 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=72 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:30.538253 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-45428e86-d03f-4c41-8094-b8fd37099b8b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:30.538837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-45428e86-d03f-4c41-8094-b8fd37099b8b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:30.539350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-45428e86-d03f-4c41-8094-b8fd37099b8b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:30.540201 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-45428e86-d03f-4c41-8094-b8fd37099b8b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:30.540729 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-45428e86-d03f-4c41-8094-b8fd37099b8b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:30.541278 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-45428e86-d03f-4c41-8094-b8fd37099b8b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:30.692233 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-45428e86-d03f-4c41-8094-b8fd37099b8b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:30.693263 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bd624b08-bca7-4571-a8ca-7dba5b9557b0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:30.693893 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bd624b08-bca7-4571-a8ca-7dba5b9557b0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:30.700736 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd624b08-bca7-4571-a8ca-7dba5b9557b0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:30.701609 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd624b08-bca7-4571-a8ca-7dba5b9557b0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:30.702230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd624b08-bca7-4571-a8ca-7dba5b9557b0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:30.703149 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd624b08-bca7-4571-a8ca-7dba5b9557b0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:30.703852 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd624b08-bca7-4571-a8ca-7dba5b9557b0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:30.704487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd624b08-bca7-4571-a8ca-7dba5b9557b0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:30.705191 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-45428e86-d03f-4c41-8094-b8fd37099b8b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.189680 Aug 30 01:20:30.719328 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 206/407] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:30 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:30.778157 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bd624b08-bca7-4571-a8ca-7dba5b9557b0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:30.786936 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bd624b08-bca7-4571-a8ca-7dba5b9557b0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1315 microversion: 2.1 time: 0.104769 Aug 30 01:20:30.787594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 202/408] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:30 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1315 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:31.727982 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4971c698-28c9-48ca-a1b7-d196d70d9942 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:31.728772 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4971c698-28c9-48ca-a1b7-d196d70d9942 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:31.735574 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4971c698-28c9-48ca-a1b7-d196d70d9942 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:31.736107 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4971c698-28c9-48ca-a1b7-d196d70d9942 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:31.736540 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4971c698-28c9-48ca-a1b7-d196d70d9942 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:31.738121 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4971c698-28c9-48ca-a1b7-d196d70d9942 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:31.738753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4971c698-28c9-48ca-a1b7-d196d70d9942 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:31.739184 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4971c698-28c9-48ca-a1b7-d196d70d9942 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:31.809377 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-befb4dfa-af9f-46c5-ad79-f31ba46914c3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:31.810123 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-befb4dfa-af9f-46c5-ad79-f31ba46914c3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:31.823856 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-befb4dfa-af9f-46c5-ad79-f31ba46914c3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:31.826382 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-befb4dfa-af9f-46c5-ad79-f31ba46914c3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:31.826844 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-befb4dfa-af9f-46c5-ad79-f31ba46914c3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:31.827582 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-befb4dfa-af9f-46c5-ad79-f31ba46914c3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:31.828070 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-befb4dfa-af9f-46c5-ad79-f31ba46914c3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:31.828504 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-befb4dfa-af9f-46c5-ad79-f31ba46914c3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:31.926450 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-befb4dfa-af9f-46c5-ad79-f31ba46914c3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:31.935291 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-befb4dfa-af9f-46c5-ad79-f31ba46914c3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1315 microversion: 2.1 time: 0.129933 Aug 30 01:20:31.936156 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 203/409] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:31 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1315 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:31.956153 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4971c698-28c9-48ca-a1b7-d196d70d9942 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:31.968193 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4971c698-28c9-48ca-a1b7-d196d70d9942 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.244512 Aug 30 01:20:31.969089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 207/410] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:31 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:32.957198 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-54405bde-56e0-4710-ada5-7853a76d05c1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:32.959385 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-54405bde-56e0-4710-ada5-7853a76d05c1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:32.963079 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:32.966916 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-54405bde-56e0-4710-ada5-7853a76d05c1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:32.967522 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-54405bde-56e0-4710-ada5-7853a76d05c1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:32.968253 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-54405bde-56e0-4710-ada5-7853a76d05c1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:32.969028 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-54405bde-56e0-4710-ada5-7853a76d05c1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:32.969547 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-54405bde-56e0-4710-ada5-7853a76d05c1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:32.970041 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-54405bde-56e0-4710-ada5-7853a76d05c1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:32.990393 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d9d79fae-a8b9-445e-b966-ab6534c9fc53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:32.991000 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d9d79fae-a8b9-445e-b966-ab6534c9fc53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:32.997628 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9d79fae-a8b9-445e-b966-ab6534c9fc53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:32.998118 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9d79fae-a8b9-445e-b966-ab6534c9fc53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:32.998553 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9d79fae-a8b9-445e-b966-ab6534c9fc53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:32.999249 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9d79fae-a8b9-445e-b966-ab6534c9fc53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:32.999732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9d79fae-a8b9-445e-b966-ab6534c9fc53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:33.000189 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9d79fae-a8b9-445e-b966-ab6534c9fc53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:33.047855 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-54405bde-56e0-4710-ada5-7853a76d05c1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:33.056275 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-54405bde-56e0-4710-ada5-7853a76d05c1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1315 microversion: 2.1 time: 0.103551 Aug 30 01:20:33.060137 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 204/411] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:32 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1315 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:33.168138 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d9d79fae-a8b9-445e-b966-ab6534c9fc53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:33.181352 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d9d79fae-a8b9-445e-b966-ab6534c9fc53 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.194591 Aug 30 01:20:33.188674 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 208/412] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:32 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:34.078828 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-da3c0abb-931d-48a5-b4b7-3dff5096dee0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:34.079433 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-da3c0abb-931d-48a5-b4b7-3dff5096dee0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:34.087375 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da3c0abb-931d-48a5-b4b7-3dff5096dee0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:34.087867 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da3c0abb-931d-48a5-b4b7-3dff5096dee0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:34.088333 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da3c0abb-931d-48a5-b4b7-3dff5096dee0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:34.089048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da3c0abb-931d-48a5-b4b7-3dff5096dee0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:34.089497 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da3c0abb-931d-48a5-b4b7-3dff5096dee0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:34.089925 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da3c0abb-931d-48a5-b4b7-3dff5096dee0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:34.159987 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-da3c0abb-931d-48a5-b4b7-3dff5096dee0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:34.168962 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-da3c0abb-931d-48a5-b4b7-3dff5096dee0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1315 microversion: 2.1 time: 0.093894 Aug 30 01:20:34.169545 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 205/413] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:34 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1315 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:34.203742 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-406e765a-94a3-4400-ada1-29b439c96472 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:34.204489 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-406e765a-94a3-4400-ada1-29b439c96472 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:34.212711 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-406e765a-94a3-4400-ada1-29b439c96472 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:34.213711 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-406e765a-94a3-4400-ada1-29b439c96472 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:34.214417 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-406e765a-94a3-4400-ada1-29b439c96472 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:34.215395 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-406e765a-94a3-4400-ada1-29b439c96472 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:34.216116 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-406e765a-94a3-4400-ada1-29b439c96472 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:34.216895 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-406e765a-94a3-4400-ada1-29b439c96472 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:34.363136 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-406e765a-94a3-4400-ada1-29b439c96472 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:34.372272 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-406e765a-94a3-4400-ada1-29b439c96472 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.172878 Aug 30 01:20:34.373100 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 209/414] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:34 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:34.780933 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-219e4b1e-6e6f-45d2-aabd-35abf575f288 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:34.781427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-219e4b1e-6e6f-45d2-aabd-35abf575f288 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:34.788332 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-219e4b1e-6e6f-45d2-aabd-35abf575f288 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:34.788843 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-219e4b1e-6e6f-45d2-aabd-35abf575f288 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:34.789275 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-219e4b1e-6e6f-45d2-aabd-35abf575f288 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:34.789977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-219e4b1e-6e6f-45d2-aabd-35abf575f288 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:34.790427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-219e4b1e-6e6f-45d2-aabd-35abf575f288 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:34.790847 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-219e4b1e-6e6f-45d2-aabd-35abf575f288 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:34.920210 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-219e4b1e-6e6f-45d2-aabd-35abf575f288 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lazy-loading 'services' on Instance uuid 0069d16b-f85d-43f1-a310-6036df89e8e1 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:20:35.037146 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-219e4b1e-6e6f-45d2-aabd-35abf575f288 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1/os-volume_attachments/91ed8dc1-44fc-40ec-99b0-f0292f965c57" status: 202 len: 0 microversion: 2.1 time: 0.259828 Aug 30 01:20:35.037954 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 206/415] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Aug 30 01:20:34 2022] DELETE /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1/os-volume_attachments/91ed8dc1-44fc-40ec-99b0-f0292f965c57 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:20:35.189651 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-02596393-cee5-4656-8c2e-78426f0e0997 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:35.190974 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-02596393-cee5-4656-8c2e-78426f0e0997 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:35.196886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-02596393-cee5-4656-8c2e-78426f0e0997 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:35.197356 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-02596393-cee5-4656-8c2e-78426f0e0997 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:35.197785 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-02596393-cee5-4656-8c2e-78426f0e0997 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:35.198522 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-02596393-cee5-4656-8c2e-78426f0e0997 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:35.198994 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-02596393-cee5-4656-8c2e-78426f0e0997 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:35.199407 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-02596393-cee5-4656-8c2e-78426f0e0997 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:35.261632 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-02596393-cee5-4656-8c2e-78426f0e0997 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:35.269597 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-02596393-cee5-4656-8c2e-78426f0e0997 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1315 microversion: 2.1 time: 0.083865 Aug 30 01:20:35.270147 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 210/416] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:35 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1315 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:35.396383 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b49bf218-d4bb-4f27-905e-a6e8a87f4119 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:35.397087 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b49bf218-d4bb-4f27-905e-a6e8a87f4119 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:35.403381 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b49bf218-d4bb-4f27-905e-a6e8a87f4119 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:35.403858 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b49bf218-d4bb-4f27-905e-a6e8a87f4119 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:35.404328 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b49bf218-d4bb-4f27-905e-a6e8a87f4119 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:35.405017 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b49bf218-d4bb-4f27-905e-a6e8a87f4119 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:35.405461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b49bf218-d4bb-4f27-905e-a6e8a87f4119 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:35.405880 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b49bf218-d4bb-4f27-905e-a6e8a87f4119 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:35.544483 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b49bf218-d4bb-4f27-905e-a6e8a87f4119 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:35.553661 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b49bf218-d4bb-4f27-905e-a6e8a87f4119 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.163001 Aug 30 01:20:35.554472 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 207/417] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:35 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:36.290397 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1e0669bc-11ef-4f28-b6a3-ccd946d2bc57 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:36.291692 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1e0669bc-11ef-4f28-b6a3-ccd946d2bc57 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:36.298678 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e0669bc-11ef-4f28-b6a3-ccd946d2bc57 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:36.299637 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e0669bc-11ef-4f28-b6a3-ccd946d2bc57 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:36.300285 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e0669bc-11ef-4f28-b6a3-ccd946d2bc57 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:36.301374 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e0669bc-11ef-4f28-b6a3-ccd946d2bc57 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:36.302002 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e0669bc-11ef-4f28-b6a3-ccd946d2bc57 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:36.302593 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e0669bc-11ef-4f28-b6a3-ccd946d2bc57 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:36.462793 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1e0669bc-11ef-4f28-b6a3-ccd946d2bc57 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:36.474136 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1e0669bc-11ef-4f28-b6a3-ccd946d2bc57 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.187501 Aug 30 01:20:36.482875 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 211/418] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:36 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:36.578997 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-93a8fff7-2f06-487a-921d-4ae5fe1e2e1c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:36.581471 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-93a8fff7-2f06-487a-921d-4ae5fe1e2e1c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:36.591790 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-93a8fff7-2f06-487a-921d-4ae5fe1e2e1c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:36.592793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-93a8fff7-2f06-487a-921d-4ae5fe1e2e1c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:36.593254 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-93a8fff7-2f06-487a-921d-4ae5fe1e2e1c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:36.594650 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-93a8fff7-2f06-487a-921d-4ae5fe1e2e1c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:36.595126 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-93a8fff7-2f06-487a-921d-4ae5fe1e2e1c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:36.596660 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-93a8fff7-2f06-487a-921d-4ae5fe1e2e1c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:36.627178 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:36.880571 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-93a8fff7-2f06-487a-921d-4ae5fe1e2e1c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:36.892157 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-93a8fff7-2f06-487a-921d-4ae5fe1e2e1c tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.320451 Aug 30 01:20:36.893003 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 208/419] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:36 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:37.210454 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-1ff904f5-dd3f-4d9a-8b45-4a992500640d req-4d5a3d04-017a-40c6-b097-29994ca362e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f03d56-24a2-4446-8eec-c95cb2050d24", "tag": "481cfbb3-ad8c-4d71-a2e4-067031b651cb"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:37.222996 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1ff904f5-dd3f-4d9a-8b45-4a992500640d req-4d5a3d04-017a-40c6-b097-29994ca362e8 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:37.223508 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1ff904f5-dd3f-4d9a-8b45-4a992500640d req-4d5a3d04-017a-40c6-b097-29994ca362e8 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:37.223946 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1ff904f5-dd3f-4d9a-8b45-4a992500640d req-4d5a3d04-017a-40c6-b097-29994ca362e8 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:37.234230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-687a3ac8-00a6-4385-8fd3-c566fa5f70a4 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:37.234725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-687a3ac8-00a6-4385-8fd3-c566fa5f70a4 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:37.237748 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-1ff904f5-dd3f-4d9a-8b45-4a992500640d req-4d5a3d04-017a-40c6-b097-29994ca362e8 service nova] Creating event network-changed:481cfbb3-ad8c-4d71-a2e4-067031b651cb for instance c0f03d56-24a2-4446-8eec-c95cb2050d24 on hv-cinder-81514 Aug 30 01:20:37.242816 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-1ff904f5-dd3f-4d9a-8b45-4a992500640d req-4d5a3d04-017a-40c6-b097-29994ca362e8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036047 Aug 30 01:20:37.243668 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 212/420] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:37.244824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-687a3ac8-00a6-4385-8fd3-c566fa5f70a4 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:37.245326 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-687a3ac8-00a6-4385-8fd3-c566fa5f70a4 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:37.246171 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-687a3ac8-00a6-4385-8fd3-c566fa5f70a4 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:37.246785 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-687a3ac8-00a6-4385-8fd3-c566fa5f70a4 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:37.247411 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-687a3ac8-00a6-4385-8fd3-c566fa5f70a4 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:37.247839 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-687a3ac8-00a6-4385-8fd3-c566fa5f70a4 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:37.275006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-687a3ac8-00a6-4385-8fd3-c566fa5f70a4 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:20:37.359987 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-687a3ac8-00a6-4385-8fd3-c566fa5f70a4 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 204 len: 0 microversion: 2.1 time: 0.129282 Aug 30 01:20:37.360611 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 209/421] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:20:37 2022] DELETE /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:20:37.370748 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5d15401b-1b2b-4bd8-b49e-d4d9335a1140 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:37.371395 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5d15401b-1b2b-4bd8-b49e-d4d9335a1140 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:37.378009 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d15401b-1b2b-4bd8-b49e-d4d9335a1140 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:37.378498 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d15401b-1b2b-4bd8-b49e-d4d9335a1140 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:37.378934 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d15401b-1b2b-4bd8-b49e-d4d9335a1140 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:37.379640 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d15401b-1b2b-4bd8-b49e-d4d9335a1140 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:37.380144 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d15401b-1b2b-4bd8-b49e-d4d9335a1140 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:37.380574 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d15401b-1b2b-4bd8-b49e-d4d9335a1140 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:37.504880 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0afa20ec-f4e6-4ac9-970c-2dc025a6ebd5 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:37.505929 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0afa20ec-f4e6-4ac9-970c-2dc025a6ebd5 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:37.512323 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0afa20ec-f4e6-4ac9-970c-2dc025a6ebd5 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:37.512806 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0afa20ec-f4e6-4ac9-970c-2dc025a6ebd5 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:37.513241 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0afa20ec-f4e6-4ac9-970c-2dc025a6ebd5 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:37.513957 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0afa20ec-f4e6-4ac9-970c-2dc025a6ebd5 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:37.514402 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0afa20ec-f4e6-4ac9-970c-2dc025a6ebd5 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:37.514830 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0afa20ec-f4e6-4ac9-970c-2dc025a6ebd5 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:37.523808 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5d15401b-1b2b-4bd8-b49e-d4d9335a1140 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:37.532713 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5d15401b-1b2b-4bd8-b49e-d4d9335a1140 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1512 microversion: 2.1 time: 0.166755 Aug 30 01:20:37.534599 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 213/422] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:37 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:37.650656 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0afa20ec-f4e6-4ac9-970c-2dc025a6ebd5 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:37.659276 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0afa20ec-f4e6-4ac9-970c-2dc025a6ebd5 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.158801 Aug 30 01:20:37.659846 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 210/423] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:37 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:37.915439 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a8f69bcb-b2a9-4c4f-9fb3-41159c6b4294 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:37.915968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a8f69bcb-b2a9-4c4f-9fb3-41159c6b4294 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:37.921895 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8f69bcb-b2a9-4c4f-9fb3-41159c6b4294 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:37.922367 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8f69bcb-b2a9-4c4f-9fb3-41159c6b4294 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:37.922792 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8f69bcb-b2a9-4c4f-9fb3-41159c6b4294 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:37.923467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8f69bcb-b2a9-4c4f-9fb3-41159c6b4294 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:37.924727 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8f69bcb-b2a9-4c4f-9fb3-41159c6b4294 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:37.925161 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8f69bcb-b2a9-4c4f-9fb3-41159c6b4294 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:38.066857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a8f69bcb-b2a9-4c4f-9fb3-41159c6b4294 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:38.075836 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a8f69bcb-b2a9-4c4f-9fb3-41159c6b4294 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.164278 Aug 30 01:20:38.076453 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 214/424] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:37 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:38.556684 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bbeef642-81b5-482b-8cb3-925b1ecb0b87 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:38.557289 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bbeef642-81b5-482b-8cb3-925b1ecb0b87 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:38.563727 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbeef642-81b5-482b-8cb3-925b1ecb0b87 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:38.564245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbeef642-81b5-482b-8cb3-925b1ecb0b87 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:38.565352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbeef642-81b5-482b-8cb3-925b1ecb0b87 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:38.566054 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbeef642-81b5-482b-8cb3-925b1ecb0b87 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:38.566496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbeef642-81b5-482b-8cb3-925b1ecb0b87 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:38.566912 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbeef642-81b5-482b-8cb3-925b1ecb0b87 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:38.683338 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-46f4f557-62f0-411a-9651-10a7c2c43c53 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:38.684574 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-46f4f557-62f0-411a-9651-10a7c2c43c53 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:38.696978 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46f4f557-62f0-411a-9651-10a7c2c43c53 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:38.697852 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46f4f557-62f0-411a-9651-10a7c2c43c53 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:38.698607 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46f4f557-62f0-411a-9651-10a7c2c43c53 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:38.699843 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46f4f557-62f0-411a-9651-10a7c2c43c53 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:38.700711 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46f4f557-62f0-411a-9651-10a7c2c43c53 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:38.701518 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46f4f557-62f0-411a-9651-10a7c2c43c53 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:38.721526 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bbeef642-81b5-482b-8cb3-925b1ecb0b87 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:38.729600 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bbeef642-81b5-482b-8cb3-925b1ecb0b87 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1512 microversion: 2.1 time: 0.176810 Aug 30 01:20:38.730165 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 211/425] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:38 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:38.842703 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-46f4f557-62f0-411a-9651-10a7c2c43c53 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:38.851046 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-46f4f557-62f0-411a-9651-10a7c2c43c53 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.174939 Aug 30 01:20:38.851607 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 215/426] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:38 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:39.098823 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6bfd81c8-4a9e-4d09-b305-9b3ac5db2da8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:39.099352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6bfd81c8-4a9e-4d09-b305-9b3ac5db2da8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:39.105491 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bfd81c8-4a9e-4d09-b305-9b3ac5db2da8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:39.105970 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bfd81c8-4a9e-4d09-b305-9b3ac5db2da8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:39.106398 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bfd81c8-4a9e-4d09-b305-9b3ac5db2da8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:39.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bfd81c8-4a9e-4d09-b305-9b3ac5db2da8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:39.107525 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bfd81c8-4a9e-4d09-b305-9b3ac5db2da8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:39.107940 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bfd81c8-4a9e-4d09-b305-9b3ac5db2da8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:39.246498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6bfd81c8-4a9e-4d09-b305-9b3ac5db2da8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:39.255925 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6bfd81c8-4a9e-4d09-b305-9b3ac5db2da8 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.161974 Aug 30 01:20:39.256543 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 212/427] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:39 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:39.750922 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-13ecb46c-449b-46fc-82d7-433ede0e15fc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:39.752031 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-13ecb46c-449b-46fc-82d7-433ede0e15fc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:39.758985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13ecb46c-449b-46fc-82d7-433ede0e15fc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:39.759541 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13ecb46c-449b-46fc-82d7-433ede0e15fc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:39.759904 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13ecb46c-449b-46fc-82d7-433ede0e15fc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:39.760649 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13ecb46c-449b-46fc-82d7-433ede0e15fc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:39.761102 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13ecb46c-449b-46fc-82d7-433ede0e15fc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:39.761525 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13ecb46c-449b-46fc-82d7-433ede0e15fc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:39.873098 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8f9a0717-45d9-4baa-aeb4-c80e0398dfc7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:39.874472 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8f9a0717-45d9-4baa-aeb4-c80e0398dfc7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:39.882890 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8f9a0717-45d9-4baa-aeb4-c80e0398dfc7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:39.883739 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8f9a0717-45d9-4baa-aeb4-c80e0398dfc7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:39.884538 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8f9a0717-45d9-4baa-aeb4-c80e0398dfc7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:39.885454 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8f9a0717-45d9-4baa-aeb4-c80e0398dfc7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:39.886065 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8f9a0717-45d9-4baa-aeb4-c80e0398dfc7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:39.886645 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8f9a0717-45d9-4baa-aeb4-c80e0398dfc7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:39.958652 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-13ecb46c-449b-46fc-82d7-433ede0e15fc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:39.966544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-13ecb46c-449b-46fc-82d7-433ede0e15fc tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1512 microversion: 2.1 time: 0.219808 Aug 30 01:20:39.967124 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 216/428] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:39 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:40.062606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8f9a0717-45d9-4baa-aeb4-c80e0398dfc7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:40.072247 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8f9a0717-45d9-4baa-aeb4-c80e0398dfc7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.203621 Aug 30 01:20:40.072825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 213/429] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:39 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:40.277833 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cc10a4e2-96e8-46c6-bbe3-9aa2b409f71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:40.278838 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cc10a4e2-96e8-46c6-bbe3-9aa2b409f71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:40.285321 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc10a4e2-96e8-46c6-bbe3-9aa2b409f71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:40.285801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc10a4e2-96e8-46c6-bbe3-9aa2b409f71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:40.286258 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc10a4e2-96e8-46c6-bbe3-9aa2b409f71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:40.287346 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc10a4e2-96e8-46c6-bbe3-9aa2b409f71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:40.287952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc10a4e2-96e8-46c6-bbe3-9aa2b409f71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:40.288744 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc10a4e2-96e8-46c6-bbe3-9aa2b409f71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:40.505494 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-cc10a4e2-96e8-46c6-bbe3-9aa2b409f71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:40.514816 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cc10a4e2-96e8-46c6-bbe3-9aa2b409f71f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.240754 Aug 30 01:20:40.515735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 217/430] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:40 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:40.558299 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-22a03ecf-15c2-44f0-ab14-9f91312d2e4d req-be3ea17c-637f-4b56-aa5a-2035907fb01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0069d16b-f85d-43f1-a310-6036df89e8e1", "name": "network-vif-deleted", "tag": "5b76e68a-559f-498b-b2ff-b979997a5a2d"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:40.569083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-22a03ecf-15c2-44f0-ab14-9f91312d2e4d req-be3ea17c-637f-4b56-aa5a-2035907fb01d service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:40.569562 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-22a03ecf-15c2-44f0-ab14-9f91312d2e4d req-be3ea17c-637f-4b56-aa5a-2035907fb01d service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:40.569990 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-22a03ecf-15c2-44f0-ab14-9f91312d2e4d req-be3ea17c-637f-4b56-aa5a-2035907fb01d service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:40.583203 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-22a03ecf-15c2-44f0-ab14-9f91312d2e4d req-be3ea17c-637f-4b56-aa5a-2035907fb01d service nova] Creating event network-vif-deleted:5b76e68a-559f-498b-b2ff-b979997a5a2d for instance 0069d16b-f85d-43f1-a310-6036df89e8e1 on hv-cinder-81514 Aug 30 01:20:40.588373 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-22a03ecf-15c2-44f0-ab14-9f91312d2e4d req-be3ea17c-637f-4b56-aa5a-2035907fb01d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034699 Aug 30 01:20:40.588976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 214/431] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:40.989084 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:40.989683 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:40.998961 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:40.999444 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:40.999870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:41.000582 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:41.001034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:41.002069 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:41.035027 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:41.035500 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:41.035928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:41.036393 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lazy-loading 'fault' on Instance uuid 0069d16b-f85d-43f1-a310-6036df89e8e1 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:20:41.078692 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:41.086641 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-06f1c210-7ce2-4aca-9a2d-0d1537fe69f7 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1308 microversion: 2.1 time: 0.102288 Aug 30 01:20:41.087214 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 218/432] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:40 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:41.094930 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e6375ad2-63db-4d8c-be48-2aba18e467d0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:41.096277 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e6375ad2-63db-4d8c-be48-2aba18e467d0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:41.102508 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6375ad2-63db-4d8c-be48-2aba18e467d0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:41.102984 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6375ad2-63db-4d8c-be48-2aba18e467d0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:41.103413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6375ad2-63db-4d8c-be48-2aba18e467d0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:41.104130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6375ad2-63db-4d8c-be48-2aba18e467d0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:41.104578 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6375ad2-63db-4d8c-be48-2aba18e467d0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:41.104999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6375ad2-63db-4d8c-be48-2aba18e467d0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:41.256483 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e6375ad2-63db-4d8c-be48-2aba18e467d0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:41.264310 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e6375ad2-63db-4d8c-be48-2aba18e467d0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.173940 Aug 30 01:20:41.264877 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 215/433] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:41 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:41.537354 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0ddced0a-ef46-43ac-a340-5ddb7e8e657a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:41.537880 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0ddced0a-ef46-43ac-a340-5ddb7e8e657a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:41.543777 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ddced0a-ef46-43ac-a340-5ddb7e8e657a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:41.544292 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ddced0a-ef46-43ac-a340-5ddb7e8e657a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:41.544728 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ddced0a-ef46-43ac-a340-5ddb7e8e657a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:41.545411 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ddced0a-ef46-43ac-a340-5ddb7e8e657a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:41.545866 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ddced0a-ef46-43ac-a340-5ddb7e8e657a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:41.546288 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ddced0a-ef46-43ac-a340-5ddb7e8e657a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:41.678155 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0ddced0a-ef46-43ac-a340-5ddb7e8e657a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:41.701872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0ddced0a-ef46-43ac-a340-5ddb7e8e657a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.168608 Aug 30 01:20:41.702479 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 219/434] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:41 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:42.110322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:42.110907 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:42.117688 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:42.118181 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:42.118621 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:42.119346 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:42.119805 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:42.120268 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:42.154576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:42.155151 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:42.155682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:42.156223 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lazy-loading 'fault' on Instance uuid 0069d16b-f85d-43f1-a310-6036df89e8e1 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:20:42.203532 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:42.212355 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4187c2be-e7bc-4f37-88fe-e0bdfeae8be3 tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1308 microversion: 2.1 time: 0.106031 Aug 30 01:20:42.212925 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 216/435] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:42 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:42.284916 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e79c40f6-89cd-432d-b6f9-f4057c405212 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:42.285525 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e79c40f6-89cd-432d-b6f9-f4057c405212 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:42.292133 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e79c40f6-89cd-432d-b6f9-f4057c405212 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:42.292611 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e79c40f6-89cd-432d-b6f9-f4057c405212 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:42.293044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e79c40f6-89cd-432d-b6f9-f4057c405212 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:42.293748 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e79c40f6-89cd-432d-b6f9-f4057c405212 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:42.294202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e79c40f6-89cd-432d-b6f9-f4057c405212 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:42.294622 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e79c40f6-89cd-432d-b6f9-f4057c405212 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:42.428857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e79c40f6-89cd-432d-b6f9-f4057c405212 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:42.436638 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e79c40f6-89cd-432d-b6f9-f4057c405212 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.155632 Aug 30 01:20:42.437204 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 220/436] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:42 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:42.724655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b5ddfbcc-ac4f-485e-9888-b3532240c775 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:42.725271 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b5ddfbcc-ac4f-485e-9888-b3532240c775 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:42.731205 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5ddfbcc-ac4f-485e-9888-b3532240c775 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:42.731721 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5ddfbcc-ac4f-485e-9888-b3532240c775 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:42.732194 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5ddfbcc-ac4f-485e-9888-b3532240c775 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:42.732882 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5ddfbcc-ac4f-485e-9888-b3532240c775 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:42.733335 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5ddfbcc-ac4f-485e-9888-b3532240c775 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:42.733758 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5ddfbcc-ac4f-485e-9888-b3532240c775 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:42.862769 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b5ddfbcc-ac4f-485e-9888-b3532240c775 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:42.871575 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b5ddfbcc-ac4f-485e-9888-b3532240c775 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.151402 Aug 30 01:20:42.872203 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 217/437] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:42 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:43.233665 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:43.234300 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:43.240589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:43.241067 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:43.241497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:43.242185 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:43.242627 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:43.243044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:43.245909 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:43.276252 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:43.276635 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:43.277065 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:43.277505 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lazy-loading 'fault' on Instance uuid 0069d16b-f85d-43f1-a310-6036df89e8e1 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:20:43.320451 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b579837fb4434282224eb7b83e57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2815adc7e64040c8986b1bd3f4519343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:43.328911 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b8673d6e-b341-4252-804a-dc5049a2ec1e tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 200 len: 1308 microversion: 2.1 time: 0.098942 Aug 30 01:20:43.329507 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 221/438] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:43 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:43.458257 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5bdf78d5-fc73-4582-9268-1b6ecc1d5279 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:43.458966 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5bdf78d5-fc73-4582-9268-1b6ecc1d5279 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:43.465555 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5bdf78d5-fc73-4582-9268-1b6ecc1d5279 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:43.466033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5bdf78d5-fc73-4582-9268-1b6ecc1d5279 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:43.466468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5bdf78d5-fc73-4582-9268-1b6ecc1d5279 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:43.467164 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5bdf78d5-fc73-4582-9268-1b6ecc1d5279 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:43.467618 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5bdf78d5-fc73-4582-9268-1b6ecc1d5279 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:43.468071 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5bdf78d5-fc73-4582-9268-1b6ecc1d5279 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:43.604928 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5bdf78d5-fc73-4582-9268-1b6ecc1d5279 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:43.613575 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5bdf78d5-fc73-4582-9268-1b6ecc1d5279 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.159897 Aug 30 01:20:43.614150 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 218/439] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:43 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:43.893884 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-dd6923b6-df2b-444f-a567-97a271b1b867 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:43.894497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-dd6923b6-df2b-444f-a567-97a271b1b867 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:43.900765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd6923b6-df2b-444f-a567-97a271b1b867 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:43.901258 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd6923b6-df2b-444f-a567-97a271b1b867 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:43.901695 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd6923b6-df2b-444f-a567-97a271b1b867 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:43.902397 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd6923b6-df2b-444f-a567-97a271b1b867 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:43.902854 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd6923b6-df2b-444f-a567-97a271b1b867 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:43.903284 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd6923b6-df2b-444f-a567-97a271b1b867 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:44.034819 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-dd6923b6-df2b-444f-a567-97a271b1b867 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:44.042968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-dd6923b6-df2b-444f-a567-97a271b1b867 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.153066 Aug 30 01:20:44.043552 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 222/440] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:43 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:44.362007 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-220ea10b-d141-4de0-b27b-66468b0eceae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:44.362626 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-220ea10b-d141-4de0-b27b-66468b0eceae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] [instance: 0069d16b-f85d-43f1-a310-6036df89e8e1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:44.368769 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-220ea10b-d141-4de0-b27b-66468b0eceae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:44.369285 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-220ea10b-d141-4de0-b27b-66468b0eceae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:44.369718 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-220ea10b-d141-4de0-b27b-66468b0eceae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:44.370409 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-220ea10b-d141-4de0-b27b-66468b0eceae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:44.370869 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-220ea10b-d141-4de0-b27b-66468b0eceae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:44.371288 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-220ea10b-d141-4de0-b27b-66468b0eceae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:44.386014 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-220ea10b-d141-4de0-b27b-66468b0eceae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] HTTP exception thrown: Instance 0069d16b-f85d-43f1-a310-6036df89e8e1 could not be found. Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-220ea10b-d141-4de0-b27b-66468b0eceae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Request method failure captured: Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 HTTP/1.1 Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWVVB0TM4bljELh5Tu9c2gY-My6g1f766aUo2FOqi54vgVHENRbw9CuP1uLiwZmgDr9zC2ks6Do19RCNCIKyR7-2Bf1D1ine4WdhRiFW-M9KLcVHks7lsQ_4x1ZMLDuPO2hzwkWCBLIlcU255pd2L1MyHgz7hTjZPu_13Gg8XwUWpEs Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 2815adc7e64040c8986b1bd3f4519343 Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1762091566 Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:20:44.387679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:20:44.389163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2815adc7e64040c8986b1bd3f4519343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2815adc7e64040c8986b1bd3f4519343"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2815adc7e64040c8986b1bd3f4519343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2815adc7e64040c8986b1bd3f4519343"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:20:44.389163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesSnapshotTestJSON-1762091566 Aug 30 01:20:44.389163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 2815adc7e64040c8986b1bd3f4519343 Aug 30 01:20:44.389163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1762091566 Aug 30 01:20:44.389163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesSnapshotTestJSON-1762091566-project Aug 30 01:20:44.389163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:20:44.389163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:20:44.389163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 64b579837fb4434282224eb7b83e57ab Aug 30 01:20:44.389163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesSnapshotTestJSON-1762091566-project Aug 30 01:20:44.389163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:20:44.389163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 0069d16b-f85d-43f1-a310-6036df89e8e1 could not be found. Aug 30 01:20:44.389163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '0069d16b-f85d-43f1-a310-6036df89e8e1'} Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0069d16b-f85d-43f1-a310-6036df89e8e1 could not be found. Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:20:44.389976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0069d16b-f85d-43f1-a310-6036df89e8e1 could not be found. Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0069d16b-f85d-43f1-a310-6036df89e8e1 could not be found. Aug 30 01:20:44.391394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:20:44.393701 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-220ea10b-d141-4de0-b27b-66468b0eceae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] Returning 404 to user: Instance 0069d16b-f85d-43f1-a310-6036df89e8e1 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:20:44.393701 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-220ea10b-d141-4de0-b27b-66468b0eceae tempest-VolumesSnapshotTestJSON-1762091566 tempest-VolumesSnapshotTestJSON-1762091566-project] 10.222.0.44 "GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1" status: 404 len: 111 microversion: 2.1 time: 0.031320 Aug 30 01:20:44.393701 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 219/441] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:44 2022] GET /compute/v2.1/servers/0069d16b-f85d-43f1-a310-6036df89e8e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:20:44.635959 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-adac75a5-ad76-4d82-ae13-ed32d20b08c0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:44.636605 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-adac75a5-ad76-4d82-ae13-ed32d20b08c0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:44.644725 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-adac75a5-ad76-4d82-ae13-ed32d20b08c0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:44.644725 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-adac75a5-ad76-4d82-ae13-ed32d20b08c0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:44.644910 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-adac75a5-ad76-4d82-ae13-ed32d20b08c0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:44.645702 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-adac75a5-ad76-4d82-ae13-ed32d20b08c0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:44.646151 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-adac75a5-ad76-4d82-ae13-ed32d20b08c0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:44.646653 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-adac75a5-ad76-4d82-ae13-ed32d20b08c0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:44.793435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-adac75a5-ad76-4d82-ae13-ed32d20b08c0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:44.801903 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-adac75a5-ad76-4d82-ae13-ed32d20b08c0 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.169860 Aug 30 01:20:44.802464 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 223/442] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:44 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:45.065927 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e3f1bdd1-8e45-49bb-a84d-f9c00fddaed4 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:45.066548 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e3f1bdd1-8e45-49bb-a84d-f9c00fddaed4 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:45.073169 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e3f1bdd1-8e45-49bb-a84d-f9c00fddaed4 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:45.073653 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e3f1bdd1-8e45-49bb-a84d-f9c00fddaed4 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:45.074089 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e3f1bdd1-8e45-49bb-a84d-f9c00fddaed4 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:45.074790 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e3f1bdd1-8e45-49bb-a84d-f9c00fddaed4 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:45.075267 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e3f1bdd1-8e45-49bb-a84d-f9c00fddaed4 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:45.075672 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e3f1bdd1-8e45-49bb-a84d-f9c00fddaed4 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:45.215957 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e3f1bdd1-8e45-49bb-a84d-f9c00fddaed4 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:45.225718 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e3f1bdd1-8e45-49bb-a84d-f9c00fddaed4 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1736 microversion: 2.1 time: 0.164374 Aug 30 01:20:45.226280 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 220/443] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:45 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:45.823933 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e72c76aa-27cf-4c2c-8261-b9e230564290 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:45.824561 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e72c76aa-27cf-4c2c-8261-b9e230564290 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:45.832489 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e72c76aa-27cf-4c2c-8261-b9e230564290 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:45.833294 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e72c76aa-27cf-4c2c-8261-b9e230564290 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:45.833756 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e72c76aa-27cf-4c2c-8261-b9e230564290 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:45.834551 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e72c76aa-27cf-4c2c-8261-b9e230564290 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:45.835058 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e72c76aa-27cf-4c2c-8261-b9e230564290 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:45.835689 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e72c76aa-27cf-4c2c-8261-b9e230564290 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:45.998441 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e72c76aa-27cf-4c2c-8261-b9e230564290 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:46.007701 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e72c76aa-27cf-4c2c-8261-b9e230564290 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.187410 Aug 30 01:20:46.008094 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 224/444] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:45 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:46.247454 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0db1f37e-fe53-4cad-9118-64e60c9b0e71 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:46.248018 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0db1f37e-fe53-4cad-9118-64e60c9b0e71 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:46.256086 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0db1f37e-fe53-4cad-9118-64e60c9b0e71 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:46.256576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0db1f37e-fe53-4cad-9118-64e60c9b0e71 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:46.257016 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0db1f37e-fe53-4cad-9118-64e60c9b0e71 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:46.257726 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0db1f37e-fe53-4cad-9118-64e60c9b0e71 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:46.258180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0db1f37e-fe53-4cad-9118-64e60c9b0e71 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:46.258605 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0db1f37e-fe53-4cad-9118-64e60c9b0e71 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:46.390051 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0db1f37e-fe53-4cad-9118-64e60c9b0e71 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:46.398517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0db1f37e-fe53-4cad-9118-64e60c9b0e71 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1716 microversion: 2.1 time: 0.155247 Aug 30 01:20:46.399082 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 221/445] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:46 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:46.509164 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d9c9849b-b2e6-4cf6-a048-0b2859662ccf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:46.509659 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d9c9849b-b2e6-4cf6-a048-0b2859662ccf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:46.515634 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9c9849b-b2e6-4cf6-a048-0b2859662ccf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:46.516165 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9c9849b-b2e6-4cf6-a048-0b2859662ccf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:46.516609 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9c9849b-b2e6-4cf6-a048-0b2859662ccf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:46.517350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9c9849b-b2e6-4cf6-a048-0b2859662ccf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:46.517804 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9c9849b-b2e6-4cf6-a048-0b2859662ccf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:46.518224 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9c9849b-b2e6-4cf6-a048-0b2859662ccf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:46.605356 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-d9c9849b-b2e6-4cf6-a048-0b2859662ccf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] HTTP exception thrown: Cannot 'detach_volume' instance 9f6ce1c9-bac7-4653-8051-123c152ed7df while it is in vm_state rescued Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d9c9849b-b2e6-4cf6-a048-0b2859662ccf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Request method failure captured: Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-volume_attachments/47569380-a4e0-40e2-80c9-61f8f4a65d2a HTTP/1.1 Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWTyu2mYlr5SZBPqmuxeReqX8oUXqakHxF2IKof-fnI3tzgBe6Mk-AUTjC6A0JXOa4T6LtGD53koWf8oxieYjCOwBXRn6eJa2ckFuh7HaVg-Gba7cj6y-mZqMkJD3n-WhL5eNJRIXpizs-TyaFCR-XXy3d0GgG2JzExm_2cHDwfdcWE Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: adf47975f465467498be24ebe2c81ad7 Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:20:46.606993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:20:46.609425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_adf47975f465467498be24ebe2c81ad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:20:46.609425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:20:46.609425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: adf47975f465467498be24ebe2c81ad7 Aug 30 01:20:46.609425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:20:46.609425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-ServerRescueNegativeTestJSON-1122969509-project Aug 30 01:20:46.609425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:20:46.609425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:20:46.609425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 6d5a0cf37e3b4d3084a178f83642c144 Aug 30 01:20:46.609425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1122969509-project Aug 30 01:20:46.609425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:20:46.609425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Cannot 'detach_volume' instance 9f6ce1c9-bac7-4653-8051-123c152ed7df while it is in vm_state rescued Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'server_id': '9f6ce1c9-bac7-4653-8051-123c152ed7df', 'id': '47569380-a4e0-40e2-80c9-61f8f4a65d2a'} Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9f6ce1c9-bac7-4653-8051-123c152ed7df in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:20:46.611467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9f6ce1c9-bac7-4653-8051-123c152ed7df while it is in vm_state rescued Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9f6ce1c9-bac7-4653-8051-123c152ed7df while it is in vm_state rescued Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:20:46.614266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d9c9849b-b2e6-4cf6-a048-0b2859662ccf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Returning 409 to user: Cannot 'detach_volume' instance 9f6ce1c9-bac7-4653-8051-123c152ed7df while it is in vm_state rescued {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:20:46.616174 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d9c9849b-b2e6-4cf6-a048-0b2859662ccf tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-volume_attachments/47569380-a4e0-40e2-80c9-61f8f4a65d2a" status: 409 len: 152 microversion: 2.1 time: 0.103333 Aug 30 01:20:46.616174 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 225/446] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Aug 30 01:20:46 2022] DELETE /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-volume_attachments/47569380-a4e0-40e2-80c9-61f8f4a65d2a => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 01:20:46.619833 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-22e46fcc-c31a-48a0-9883-c72eabf82770 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:46.620398 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-22e46fcc-c31a-48a0-9883-c72eabf82770 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:46.628832 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-22e46fcc-c31a-48a0-9883-c72eabf82770 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:46.629318 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-22e46fcc-c31a-48a0-9883-c72eabf82770 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:46.629746 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-22e46fcc-c31a-48a0-9883-c72eabf82770 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:46.630431 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-22e46fcc-c31a-48a0-9883-c72eabf82770 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:46.630876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-22e46fcc-c31a-48a0-9883-c72eabf82770 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:46.631289 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-22e46fcc-c31a-48a0-9883-c72eabf82770 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:46.699041 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-22e46fcc-c31a-48a0-9883-c72eabf82770 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "POST /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/action" status: 202 len: 0 microversion: 2.1 time: 0.083005 Aug 30 01:20:46.699921 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 222/447] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:20:46 2022] POST /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:20:46.708595 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e9e75c14-fe11-4d40-993b-7acb6d1bf134 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:46.709346 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e9e75c14-fe11-4d40-993b-7acb6d1bf134 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:46.715861 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e9e75c14-fe11-4d40-993b-7acb6d1bf134 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:46.716506 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e9e75c14-fe11-4d40-993b-7acb6d1bf134 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:46.717011 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e9e75c14-fe11-4d40-993b-7acb6d1bf134 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:46.717806 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e9e75c14-fe11-4d40-993b-7acb6d1bf134 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:46.718538 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e9e75c14-fe11-4d40-993b-7acb6d1bf134 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:46.719010 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e9e75c14-fe11-4d40-993b-7acb6d1bf134 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:46.862203 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e9e75c14-fe11-4d40-993b-7acb6d1bf134 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:46.870452 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e9e75c14-fe11-4d40-993b-7acb6d1bf134 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1724 microversion: 2.1 time: 0.166391 Aug 30 01:20:46.871025 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 226/448] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:46 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:47.029517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ded77cbb-fe3a-42c4-80a1-41b7a07f246c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:47.030209 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ded77cbb-fe3a-42c4-80a1-41b7a07f246c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:47.036977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ded77cbb-fe3a-42c4-80a1-41b7a07f246c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:47.037449 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ded77cbb-fe3a-42c4-80a1-41b7a07f246c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:47.037874 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ded77cbb-fe3a-42c4-80a1-41b7a07f246c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:47.038553 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ded77cbb-fe3a-42c4-80a1-41b7a07f246c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:47.038996 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ded77cbb-fe3a-42c4-80a1-41b7a07f246c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:47.039431 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ded77cbb-fe3a-42c4-80a1-41b7a07f246c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:47.058774 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:47.193185 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ded77cbb-fe3a-42c4-80a1-41b7a07f246c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:47.201031 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ded77cbb-fe3a-42c4-80a1-41b7a07f246c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.175892 Aug 30 01:20:47.201602 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 223/449] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:47 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:47.892085 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-094b64ce-71b0-40d9-b330-c057462c0c99 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:47.892696 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-094b64ce-71b0-40d9-b330-c057462c0c99 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:47.899113 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-094b64ce-71b0-40d9-b330-c057462c0c99 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:47.899592 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-094b64ce-71b0-40d9-b330-c057462c0c99 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:47.900051 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-094b64ce-71b0-40d9-b330-c057462c0c99 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:47.900745 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-094b64ce-71b0-40d9-b330-c057462c0c99 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:47.901199 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-094b64ce-71b0-40d9-b330-c057462c0c99 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:47.901624 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-094b64ce-71b0-40d9-b330-c057462c0c99 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:48.031142 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-094b64ce-71b0-40d9-b330-c057462c0c99 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:48.039510 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-094b64ce-71b0-40d9-b330-c057462c0c99 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1724 microversion: 2.1 time: 0.151343 Aug 30 01:20:48.040094 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 227/450] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:47 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:48.224268 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1e3c5d88-85ce-4d8c-9a56-8fbd298888a7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:48.224880 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1e3c5d88-85ce-4d8c-9a56-8fbd298888a7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:48.231574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e3c5d88-85ce-4d8c-9a56-8fbd298888a7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:48.231980 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e3c5d88-85ce-4d8c-9a56-8fbd298888a7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:48.232441 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e3c5d88-85ce-4d8c-9a56-8fbd298888a7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:48.233133 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e3c5d88-85ce-4d8c-9a56-8fbd298888a7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:48.233577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e3c5d88-85ce-4d8c-9a56-8fbd298888a7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:48.233995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e3c5d88-85ce-4d8c-9a56-8fbd298888a7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:48.370316 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1e3c5d88-85ce-4d8c-9a56-8fbd298888a7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:48.378381 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1e3c5d88-85ce-4d8c-9a56-8fbd298888a7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.158029 Aug 30 01:20:48.378947 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 224/451] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:48 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:49.061555 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d634e95d-37b9-4495-86db-5cdb736ea66e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:49.062283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d634e95d-37b9-4495-86db-5cdb736ea66e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:49.071021 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d634e95d-37b9-4495-86db-5cdb736ea66e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:49.071534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d634e95d-37b9-4495-86db-5cdb736ea66e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:49.071965 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d634e95d-37b9-4495-86db-5cdb736ea66e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:49.072696 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d634e95d-37b9-4495-86db-5cdb736ea66e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:49.073141 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d634e95d-37b9-4495-86db-5cdb736ea66e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:49.073561 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d634e95d-37b9-4495-86db-5cdb736ea66e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:49.213737 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d634e95d-37b9-4495-86db-5cdb736ea66e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:49.222708 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d634e95d-37b9-4495-86db-5cdb736ea66e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1724 microversion: 2.1 time: 0.165082 Aug 30 01:20:49.223293 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 228/452] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:49 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:49.399328 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d7bf13d2-7d5c-469f-8896-0170b939a44b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:49.399942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d7bf13d2-7d5c-469f-8896-0170b939a44b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:49.406637 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7bf13d2-7d5c-469f-8896-0170b939a44b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:49.407189 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7bf13d2-7d5c-469f-8896-0170b939a44b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:49.408276 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7bf13d2-7d5c-469f-8896-0170b939a44b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:49.408984 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7bf13d2-7d5c-469f-8896-0170b939a44b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:49.409428 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7bf13d2-7d5c-469f-8896-0170b939a44b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:49.409844 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7bf13d2-7d5c-469f-8896-0170b939a44b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:49.556202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d7bf13d2-7d5c-469f-8896-0170b939a44b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:49.564847 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d7bf13d2-7d5c-469f-8896-0170b939a44b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.169739 Aug 30 01:20:49.565445 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 225/453] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:49 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:50.247104 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-51547720-663d-4149-92e3-bb2d9fde8b36 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:50.248431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-51547720-663d-4149-92e3-bb2d9fde8b36 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:50.258692 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51547720-663d-4149-92e3-bb2d9fde8b36 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:50.259712 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51547720-663d-4149-92e3-bb2d9fde8b36 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:50.260454 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51547720-663d-4149-92e3-bb2d9fde8b36 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:50.261557 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51547720-663d-4149-92e3-bb2d9fde8b36 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:50.262385 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51547720-663d-4149-92e3-bb2d9fde8b36 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:50.262960 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51547720-663d-4149-92e3-bb2d9fde8b36 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:50.304135 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-4a716698-71fb-4971-b3d4-a7beaa150ea4 req-c0164ec1-cd9b-4bd8-a3a4-c505f1d6c3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f03d56-24a2-4446-8eec-c95cb2050d24", "name": "network-vif-plugged", "status": "completed", "tag": "481cfbb3-ad8c-4d71-a2e4-067031b651cb"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:50.325540 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-4a716698-71fb-4971-b3d4-a7beaa150ea4 req-c0164ec1-cd9b-4bd8-a3a4-c505f1d6c3a9 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:50.326981 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-4a716698-71fb-4971-b3d4-a7beaa150ea4 req-c0164ec1-cd9b-4bd8-a3a4-c505f1d6c3a9 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:50.328180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-4a716698-71fb-4971-b3d4-a7beaa150ea4 req-c0164ec1-cd9b-4bd8-a3a4-c505f1d6c3a9 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:50.354181 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-4a716698-71fb-4971-b3d4-a7beaa150ea4 req-c0164ec1-cd9b-4bd8-a3a4-c505f1d6c3a9 service nova] Creating event network-vif-plugged:481cfbb3-ad8c-4d71-a2e4-067031b651cb for instance c0f03d56-24a2-4446-8eec-c95cb2050d24 on hv-cinder-81514 Aug 30 01:20:50.364211 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-4a716698-71fb-4971-b3d4-a7beaa150ea4 req-c0164ec1-cd9b-4bd8-a3a4-c505f1d6c3a9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067545 Aug 30 01:20:50.366050 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 226/454] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:50.469036 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-51547720-663d-4149-92e3-bb2d9fde8b36 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:50.479067 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-51547720-663d-4149-92e3-bb2d9fde8b36 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1724 microversion: 2.1 time: 0.237591 Aug 30 01:20:50.479698 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 229/455] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:50 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:50.587456 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1e64b17b-a18b-42c7-b549-852339a2a1d7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:50.588205 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1e64b17b-a18b-42c7-b549-852339a2a1d7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:50.594334 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e64b17b-a18b-42c7-b549-852339a2a1d7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:50.594903 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e64b17b-a18b-42c7-b549-852339a2a1d7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:50.595331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e64b17b-a18b-42c7-b549-852339a2a1d7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:50.596110 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e64b17b-a18b-42c7-b549-852339a2a1d7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:50.596585 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e64b17b-a18b-42c7-b549-852339a2a1d7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:50.597147 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e64b17b-a18b-42c7-b549-852339a2a1d7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:50.951903 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1e64b17b-a18b-42c7-b549-852339a2a1d7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:50.960546 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1e64b17b-a18b-42c7-b549-852339a2a1d7 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.377630 Aug 30 01:20:50.961130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 227/456] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:50 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:51.503792 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b4ef6d05-c559-41fa-9fd8-359253fd1d9e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:51.504474 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b4ef6d05-c559-41fa-9fd8-359253fd1d9e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:51.510998 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4ef6d05-c559-41fa-9fd8-359253fd1d9e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:51.511484 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4ef6d05-c559-41fa-9fd8-359253fd1d9e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:51.511928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4ef6d05-c559-41fa-9fd8-359253fd1d9e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:51.512650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4ef6d05-c559-41fa-9fd8-359253fd1d9e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:51.513106 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4ef6d05-c559-41fa-9fd8-359253fd1d9e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:51.513528 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4ef6d05-c559-41fa-9fd8-359253fd1d9e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:51.669204 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b4ef6d05-c559-41fa-9fd8-359253fd1d9e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:51.677905 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b4ef6d05-c559-41fa-9fd8-359253fd1d9e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1724 microversion: 2.1 time: 0.179323 Aug 30 01:20:51.678477 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 230/457] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:51 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:51.981904 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-427c33e3-ac37-49ab-9a6b-4c2a95fdb81b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:51.982517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-427c33e3-ac37-49ab-9a6b-4c2a95fdb81b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:51.988995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-427c33e3-ac37-49ab-9a6b-4c2a95fdb81b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:51.989479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-427c33e3-ac37-49ab-9a6b-4c2a95fdb81b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:51.989913 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-427c33e3-ac37-49ab-9a6b-4c2a95fdb81b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:51.990605 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-427c33e3-ac37-49ab-9a6b-4c2a95fdb81b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:51.991053 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-427c33e3-ac37-49ab-9a6b-4c2a95fdb81b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:51.991478 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-427c33e3-ac37-49ab-9a6b-4c2a95fdb81b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:52.126987 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-427c33e3-ac37-49ab-9a6b-4c2a95fdb81b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:52.136560 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-427c33e3-ac37-49ab-9a6b-4c2a95fdb81b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.158282 Aug 30 01:20:52.137297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 228/458] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:51 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:52.699386 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-410cc6a4-dc5c-49f3-bc52-20b1d6a59186 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:52.700011 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-410cc6a4-dc5c-49f3-bc52-20b1d6a59186 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:52.706727 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-410cc6a4-dc5c-49f3-bc52-20b1d6a59186 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:52.707249 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-410cc6a4-dc5c-49f3-bc52-20b1d6a59186 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:52.708120 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-410cc6a4-dc5c-49f3-bc52-20b1d6a59186 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:52.709267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-410cc6a4-dc5c-49f3-bc52-20b1d6a59186 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:52.709762 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-410cc6a4-dc5c-49f3-bc52-20b1d6a59186 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:52.710377 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-410cc6a4-dc5c-49f3-bc52-20b1d6a59186 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:52.849316 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-410cc6a4-dc5c-49f3-bc52-20b1d6a59186 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:52.857591 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-410cc6a4-dc5c-49f3-bc52-20b1d6a59186 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1730 microversion: 2.1 time: 0.162648 Aug 30 01:20:52.858151 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 231/459] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:52 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:52.880503 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-59b2c01d-d371-4ed9-ab1e-0a831f7a938a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:52.881186 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-59b2c01d-d371-4ed9-ab1e-0a831f7a938a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:52.886995 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59b2c01d-d371-4ed9-ab1e-0a831f7a938a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:52.887470 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59b2c01d-d371-4ed9-ab1e-0a831f7a938a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:52.887897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59b2c01d-d371-4ed9-ab1e-0a831f7a938a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:52.888826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59b2c01d-d371-4ed9-ab1e-0a831f7a938a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:52.889278 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59b2c01d-d371-4ed9-ab1e-0a831f7a938a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:52.889695 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59b2c01d-d371-4ed9-ab1e-0a831f7a938a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:52.967743 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-59b2c01d-d371-4ed9-ab1e-0a831f7a938a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091296 Aug 30 01:20:52.968410 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 229/460] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Aug 30 01:20:52 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:53.158828 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-91deb149-f583-4919-8d9c-42e7c34590be tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:53.159531 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-91deb149-f583-4919-8d9c-42e7c34590be tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:53.165944 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91deb149-f583-4919-8d9c-42e7c34590be tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:53.166509 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91deb149-f583-4919-8d9c-42e7c34590be tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:53.167004 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91deb149-f583-4919-8d9c-42e7c34590be tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:53.168009 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91deb149-f583-4919-8d9c-42e7c34590be tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:53.168419 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91deb149-f583-4919-8d9c-42e7c34590be tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:53.168836 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91deb149-f583-4919-8d9c-42e7c34590be tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:53.302990 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-91deb149-f583-4919-8d9c-42e7c34590be tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:53.310585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-91deb149-f583-4919-8d9c-42e7c34590be tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1357 microversion: 2.1 time: 0.156276 Aug 30 01:20:53.311152 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 232/461] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:53 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:54.115801 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-b5f534d4-bd59-41a4-b4b0-d57d6d5ef79b req-e747d513-f63e-421a-84d0-0499f4d7376c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6ce1c9-bac7-4653-8051-123c152ed7df", "tag": "4c098562-e7ad-4247-be8d-fe3c6317e383"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:54.125990 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b5f534d4-bd59-41a4-b4b0-d57d6d5ef79b req-e747d513-f63e-421a-84d0-0499f4d7376c service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:54.126766 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b5f534d4-bd59-41a4-b4b0-d57d6d5ef79b req-e747d513-f63e-421a-84d0-0499f4d7376c service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:54.127356 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b5f534d4-bd59-41a4-b4b0-d57d6d5ef79b req-e747d513-f63e-421a-84d0-0499f4d7376c service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:54.140078 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-b5f534d4-bd59-41a4-b4b0-d57d6d5ef79b req-e747d513-f63e-421a-84d0-0499f4d7376c service nova] Creating event network-changed:4c098562-e7ad-4247-be8d-fe3c6317e383 for instance 9f6ce1c9-bac7-4653-8051-123c152ed7df on hv-cinder-81514 Aug 30 01:20:54.146442 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-b5f534d4-bd59-41a4-b4b0-d57d6d5ef79b req-e747d513-f63e-421a-84d0-0499f4d7376c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034682 Aug 30 01:20:54.147592 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 230/462] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:54.333322 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-347f557e-699a-418d-a370-830c70205c09 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:54.333928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-347f557e-699a-418d-a370-830c70205c09 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:54.341448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-347f557e-699a-418d-a370-830c70205c09 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:54.342124 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-347f557e-699a-418d-a370-830c70205c09 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:54.342691 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-347f557e-699a-418d-a370-830c70205c09 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:54.343710 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-347f557e-699a-418d-a370-830c70205c09 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:54.345920 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-347f557e-699a-418d-a370-830c70205c09 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:54.346809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-347f557e-699a-418d-a370-830c70205c09 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:54.532738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-347f557e-699a-418d-a370-830c70205c09 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:54.542110 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-347f557e-699a-418d-a370-830c70205c09 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1548 microversion: 2.1 time: 0.214581 Aug 30 01:20:54.548164 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 233/463] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:54 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1548 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:54.567316 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3d521b26-8eb2-4fd6-a71c-9dd8cf44c239 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:54.568096 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3d521b26-8eb2-4fd6-a71c-9dd8cf44c239 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:54.578115 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d521b26-8eb2-4fd6-a71c-9dd8cf44c239 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:54.579068 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d521b26-8eb2-4fd6-a71c-9dd8cf44c239 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:54.579771 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d521b26-8eb2-4fd6-a71c-9dd8cf44c239 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:54.581224 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d521b26-8eb2-4fd6-a71c-9dd8cf44c239 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:54.582254 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d521b26-8eb2-4fd6-a71c-9dd8cf44c239 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:54.583278 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d521b26-8eb2-4fd6-a71c-9dd8cf44c239 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:54.773936 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3d521b26-8eb2-4fd6-a71c-9dd8cf44c239 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:54.782220 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3d521b26-8eb2-4fd6-a71c-9dd8cf44c239 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1548 microversion: 2.1 time: 0.220271 Aug 30 01:20:54.782804 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 231/464] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:54 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1548 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:54.804889 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6c46cb9f-96e5-44fd-9287-f243ead065a9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:54.810804 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6c46cb9f-96e5-44fd-9287-f243ead065a9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:54.812038 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6c46cb9f-96e5-44fd-9287-f243ead065a9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Searching by: {'deleted': False, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e'} {{(pid=120705) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 01:20:54.823085 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6c46cb9f-96e5-44fd-9287-f243ead065a9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:54.824026 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6c46cb9f-96e5-44fd-9287-f243ead065a9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:54.825166 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6c46cb9f-96e5-44fd-9287-f243ead065a9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:54.826497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6c46cb9f-96e5-44fd-9287-f243ead065a9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:54.827335 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6c46cb9f-96e5-44fd-9287-f243ead065a9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:54.828122 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6c46cb9f-96e5-44fd-9287-f243ead065a9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:54.929627 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.multi_cell_list [None req-6c46cb9f-96e5-44fd-9287-f243ead065a9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120705) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 01:20:55.052663 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6c46cb9f-96e5-44fd-9287-f243ead065a9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.253407 Aug 30 01:20:55.053352 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 234/465] 10.222.0.44 () {58 vars in 1125 bytes} [Tue Aug 30 01:20:54 2022] GET /compute/v2.1/servers => generated 342 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:20:55.071328 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-801de30a-de94-43ab-b2ab-2c7fe62d8a54 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:55.072196 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-801de30a-de94-43ab-b2ab-2c7fe62d8a54 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:55.080026 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-801de30a-de94-43ab-b2ab-2c7fe62d8a54 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:55.080627 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-801de30a-de94-43ab-b2ab-2c7fe62d8a54 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:55.081167 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-801de30a-de94-43ab-b2ab-2c7fe62d8a54 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:55.081981 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-801de30a-de94-43ab-b2ab-2c7fe62d8a54 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:55.082499 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-801de30a-de94-43ab-b2ab-2c7fe62d8a54 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:55.083044 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-801de30a-de94-43ab-b2ab-2c7fe62d8a54 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:55.240731 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-801de30a-de94-43ab-b2ab-2c7fe62d8a54 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:55.253767 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-801de30a-de94-43ab-b2ab-2c7fe62d8a54 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1548 microversion: 2.1 time: 0.187040 Aug 30 01:20:55.254658 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 232/466] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:55 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:56.168150 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-fde08793-dc6c-4c22-bd0e-bee770320bb9 req-21fbf550-9aa4-4de8-ab62-25eabdb90003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6ce1c9-bac7-4653-8051-123c152ed7df", "tag": "4c098562-e7ad-4247-be8d-fe3c6317e383"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:56.178499 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-fde08793-dc6c-4c22-bd0e-bee770320bb9 req-21fbf550-9aa4-4de8-ab62-25eabdb90003 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:56.178858 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-fde08793-dc6c-4c22-bd0e-bee770320bb9 req-21fbf550-9aa4-4de8-ab62-25eabdb90003 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:56.179287 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-fde08793-dc6c-4c22-bd0e-bee770320bb9 req-21fbf550-9aa4-4de8-ab62-25eabdb90003 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:56.190118 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-fde08793-dc6c-4c22-bd0e-bee770320bb9 req-21fbf550-9aa4-4de8-ab62-25eabdb90003 service nova] Creating event network-changed:4c098562-e7ad-4247-be8d-fe3c6317e383 for instance 9f6ce1c9-bac7-4653-8051-123c152ed7df on hv-cinder-81514 Aug 30 01:20:56.195100 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-fde08793-dc6c-4c22-bd0e-bee770320bb9 req-21fbf550-9aa4-4de8-ab62-25eabdb90003 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030760 Aug 30 01:20:56.195678 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 235/467] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:59.020499 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6f224666-d632-49c7-b970-a472ae89360f tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1955b77a-0c60-4b21-b7b6-12bed0405a04"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:59.022833 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6f224666-d632-49c7-b970-a472ae89360f tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:59.029421 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f224666-d632-49c7-b970-a472ae89360f tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:59.029904 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f224666-d632-49c7-b970-a472ae89360f tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:59.030341 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f224666-d632-49c7-b970-a472ae89360f tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:59.031035 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f224666-d632-49c7-b970-a472ae89360f tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:59.031488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f224666-d632-49c7-b970-a472ae89360f tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:59.031912 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f224666-d632-49c7-b970-a472ae89360f tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:59.342129 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6f224666-d632-49c7-b970-a472ae89360f tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "POST /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326132 Aug 30 01:20:59.342736 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 233/468] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:20:59 2022] POST /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:06.956567 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:06.957807 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=63 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:06.958601 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=89 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:06.963634 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bedfa843-2f1d-4a3d-bb26-6f1a9492235a tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:06.964358 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bedfa843-2f1d-4a3d-bb26-6f1a9492235a tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:06.972751 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bedfa843-2f1d-4a3d-bb26-6f1a9492235a tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:06.973255 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bedfa843-2f1d-4a3d-bb26-6f1a9492235a tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:06.973700 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bedfa843-2f1d-4a3d-bb26-6f1a9492235a tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:06.974410 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bedfa843-2f1d-4a3d-bb26-6f1a9492235a tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:06.974862 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bedfa843-2f1d-4a3d-bb26-6f1a9492235a tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:06.975290 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bedfa843-2f1d-4a3d-bb26-6f1a9492235a tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:07.130095 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bedfa843-2f1d-4a3d-bb26-6f1a9492235a tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:07.141435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bedfa843-2f1d-4a3d-bb26-6f1a9492235a tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1594 microversion: 2.1 time: 0.186748 Aug 30 01:21:07.142018 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 236/469] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:06 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1594 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:09.227847 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-d8851431-12c0-4504-97ff-95c1f94052fd req-a790af14-e94c-401e-b37c-72a0d151f558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f03d56-24a2-4446-8eec-c95cb2050d24", "tag": "481cfbb3-ad8c-4d71-a2e4-067031b651cb"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:09.242884 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:09.246843 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-d8851431-12c0-4504-97ff-95c1f94052fd req-a790af14-e94c-401e-b37c-72a0d151f558 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:09.247604 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-d8851431-12c0-4504-97ff-95c1f94052fd req-a790af14-e94c-401e-b37c-72a0d151f558 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:09.247818 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-d8851431-12c0-4504-97ff-95c1f94052fd req-a790af14-e94c-401e-b37c-72a0d151f558 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:09.264288 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-d8851431-12c0-4504-97ff-95c1f94052fd req-a790af14-e94c-401e-b37c-72a0d151f558 service nova] Creating event network-changed:481cfbb3-ad8c-4d71-a2e4-067031b651cb for instance c0f03d56-24a2-4446-8eec-c95cb2050d24 on hv-cinder-81514 Aug 30 01:21:09.271270 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-d8851431-12c0-4504-97ff-95c1f94052fd req-a790af14-e94c-401e-b37c-72a0d151f558 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051421 Aug 30 01:21:09.272546 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 234/470] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:10.849246 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a82ffc61-e00b-458e-ae1b-66c70c61f05b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1159516230"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:10.851455 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a82ffc61-e00b-458e-ae1b-66c70c61f05b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:10.855970 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a82ffc61-e00b-458e-ae1b-66c70c61f05b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:10.856475 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a82ffc61-e00b-458e-ae1b-66c70c61f05b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:10.856896 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a82ffc61-e00b-458e-ae1b-66c70c61f05b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:10.857599 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a82ffc61-e00b-458e-ae1b-66c70c61f05b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:10.858046 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a82ffc61-e00b-458e-ae1b-66c70c61f05b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:10.858462 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a82ffc61-e00b-458e-ae1b-66c70c61f05b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:11.015603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.network.security_group_api [None req-a82ffc61-e00b-458e-ae1b-66c70c61f05b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Adding security group 38813d61-0027-4417-83b0-48794231d787 to port 481cfbb3-ad8c-4d71-a2e4-067031b651cb Aug 30 01:21:11.388254 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a82ffc61-e00b-458e-ae1b-66c70c61f05b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "POST /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/action" status: 202 len: 0 microversion: 2.1 time: 0.546314 Aug 30 01:21:11.388897 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 237/471] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:21:10 2022] POST /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:21:11.401096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-6a7548ef-44ac-4ac2-8dc1-4edde650ac54 req-3ca66380-dac6-4353-a925-4c445108fd4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f03d56-24a2-4446-8eec-c95cb2050d24", "tag": "481cfbb3-ad8c-4d71-a2e4-067031b651cb"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:11.403630 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d4b45170-e598-4fb7-99ea-6d297bc4bd80 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:11.405353 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d4b45170-e598-4fb7-99ea-6d297bc4bd80 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:11.413362 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-6a7548ef-44ac-4ac2-8dc1-4edde650ac54 req-3ca66380-dac6-4353-a925-4c445108fd4e service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:11.413362 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-6a7548ef-44ac-4ac2-8dc1-4edde650ac54 req-3ca66380-dac6-4353-a925-4c445108fd4e service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:11.413974 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-6a7548ef-44ac-4ac2-8dc1-4edde650ac54 req-3ca66380-dac6-4353-a925-4c445108fd4e service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:11.415372 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d4b45170-e598-4fb7-99ea-6d297bc4bd80 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:11.420295 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d4b45170-e598-4fb7-99ea-6d297bc4bd80 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:11.420295 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d4b45170-e598-4fb7-99ea-6d297bc4bd80 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:11.420295 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d4b45170-e598-4fb7-99ea-6d297bc4bd80 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:11.420295 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d4b45170-e598-4fb7-99ea-6d297bc4bd80 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:11.425867 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d4b45170-e598-4fb7-99ea-6d297bc4bd80 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:11.426990 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-6a7548ef-44ac-4ac2-8dc1-4edde650ac54 req-3ca66380-dac6-4353-a925-4c445108fd4e service nova] Creating event network-changed:481cfbb3-ad8c-4d71-a2e4-067031b651cb for instance c0f03d56-24a2-4446-8eec-c95cb2050d24 on hv-cinder-81514 Aug 30 01:21:11.432521 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-6a7548ef-44ac-4ac2-8dc1-4edde650ac54 req-3ca66380-dac6-4353-a925-4c445108fd4e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036865 Aug 30 01:21:11.433672 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 238/472] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:21:11.720209 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d4b45170-e598-4fb7-99ea-6d297bc4bd80 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:11.735308 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d4b45170-e598-4fb7-99ea-6d297bc4bd80 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1760 microversion: 2.1 time: 0.339598 Aug 30 01:21:11.737351 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 235/473] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:11 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1760 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:14.078359 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-dbde4b16-179b-405d-b477-94225ff5c84f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:14.081288 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-dbde4b16-179b-405d-b477-94225ff5c84f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:14.087870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dbde4b16-179b-405d-b477-94225ff5c84f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:14.088395 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dbde4b16-179b-405d-b477-94225ff5c84f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:14.088857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dbde4b16-179b-405d-b477-94225ff5c84f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:14.089559 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dbde4b16-179b-405d-b477-94225ff5c84f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:14.090001 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dbde4b16-179b-405d-b477-94225ff5c84f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:14.090420 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dbde4b16-179b-405d-b477-94225ff5c84f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:14.125210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-dbde4b16-179b-405d-b477-94225ff5c84f tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051782 Aug 30 01:21:14.125798 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 239/474] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:21:14 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:21:14.197159 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2f5a3738-28b9-4e97-92a5-6ee5dba4ce62 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:14.197691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2f5a3738-28b9-4e97-92a5-6ee5dba4ce62 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:14.205433 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f5a3738-28b9-4e97-92a5-6ee5dba4ce62 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:14.205924 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f5a3738-28b9-4e97-92a5-6ee5dba4ce62 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:14.206362 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f5a3738-28b9-4e97-92a5-6ee5dba4ce62 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:14.207073 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f5a3738-28b9-4e97-92a5-6ee5dba4ce62 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:14.207518 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f5a3738-28b9-4e97-92a5-6ee5dba4ce62 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:14.207946 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f5a3738-28b9-4e97-92a5-6ee5dba4ce62 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:14.236406 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2f5a3738-28b9-4e97-92a5-6ee5dba4ce62 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:21:14.323194 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2f5a3738-28b9-4e97-92a5-6ee5dba4ce62 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 204 len: 0 microversion: 2.1 time: 0.129718 Aug 30 01:21:14.323867 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 236/475] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:21:14 2022] DELETE /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:21:14.333116 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-de66ac01-e1e1-4cb2-b6ed-60a0442e7243 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:14.333735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-de66ac01-e1e1-4cb2-b6ed-60a0442e7243 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:14.340040 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-de66ac01-e1e1-4cb2-b6ed-60a0442e7243 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:14.340522 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-de66ac01-e1e1-4cb2-b6ed-60a0442e7243 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:14.340960 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-de66ac01-e1e1-4cb2-b6ed-60a0442e7243 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:14.341657 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-de66ac01-e1e1-4cb2-b6ed-60a0442e7243 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:14.342114 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-de66ac01-e1e1-4cb2-b6ed-60a0442e7243 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:14.342533 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-de66ac01-e1e1-4cb2-b6ed-60a0442e7243 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:14.496475 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-de66ac01-e1e1-4cb2-b6ed-60a0442e7243 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:14.505509 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-de66ac01-e1e1-4cb2-b6ed-60a0442e7243 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1673 microversion: 2.1 time: 0.176962 Aug 30 01:21:14.506115 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 240/476] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:14 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:15.528930 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ab385548-e7ff-469f-afda-43ef61af851c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:15.529751 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ab385548-e7ff-469f-afda-43ef61af851c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:15.538046 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab385548-e7ff-469f-afda-43ef61af851c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:15.538541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab385548-e7ff-469f-afda-43ef61af851c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:15.538991 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab385548-e7ff-469f-afda-43ef61af851c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:15.539738 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab385548-e7ff-469f-afda-43ef61af851c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:15.540316 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab385548-e7ff-469f-afda-43ef61af851c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:15.540756 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab385548-e7ff-469f-afda-43ef61af851c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:15.710319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ab385548-e7ff-469f-afda-43ef61af851c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:15.722871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ab385548-e7ff-469f-afda-43ef61af851c tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1673 microversion: 2.1 time: 0.198762 Aug 30 01:21:15.723491 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 237/477] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:15 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1673 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:16.750867 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-706fd1e5-f1d6-4fb5-84a5-f01c84802fd7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:16.751944 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-706fd1e5-f1d6-4fb5-84a5-f01c84802fd7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:16.764826 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-706fd1e5-f1d6-4fb5-84a5-f01c84802fd7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:16.765824 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-706fd1e5-f1d6-4fb5-84a5-f01c84802fd7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:16.766751 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-706fd1e5-f1d6-4fb5-84a5-f01c84802fd7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:16.768224 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-706fd1e5-f1d6-4fb5-84a5-f01c84802fd7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:16.769125 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-706fd1e5-f1d6-4fb5-84a5-f01c84802fd7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:16.769853 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-706fd1e5-f1d6-4fb5-84a5-f01c84802fd7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:16.950774 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-706fd1e5-f1d6-4fb5-84a5-f01c84802fd7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:16.963076 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-706fd1e5-f1d6-4fb5-84a5-f01c84802fd7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1673 microversion: 2.1 time: 0.219800 Aug 30 01:21:16.964151 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 241/478] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:16 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1673 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:17.691819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-e7be622f-4ba1-4d92-8def-9452289df9ef req-36129484-e7d2-4969-9d88-9a57f98a4d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6657e20f-b2a0-4f01-9dca-fd276792dc73", "name": "network-vif-deleted", "tag": "21bbf672-b4dc-4800-a86f-8518de16fcca"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:17.711080 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-e7be622f-4ba1-4d92-8def-9452289df9ef req-36129484-e7d2-4969-9d88-9a57f98a4d72 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:17.712323 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-e7be622f-4ba1-4d92-8def-9452289df9ef req-36129484-e7d2-4969-9d88-9a57f98a4d72 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:17.713664 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-e7be622f-4ba1-4d92-8def-9452289df9ef req-36129484-e7d2-4969-9d88-9a57f98a4d72 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:17.720973 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:17.733348 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-e7be622f-4ba1-4d92-8def-9452289df9ef req-36129484-e7d2-4969-9d88-9a57f98a4d72 service nova] Creating event network-vif-deleted:21bbf672-b4dc-4800-a86f-8518de16fcca for instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 on hv-cinder-81514 Aug 30 01:21:17.740588 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-e7be622f-4ba1-4d92-8def-9452289df9ef req-36129484-e7d2-4969-9d88-9a57f98a4d72 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055351 Aug 30 01:21:17.741852 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 238/479] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:17.986771 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:17.987579 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:17.996028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:17.996665 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:17.997299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:17.998136 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:17.998913 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:17.999423 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:18.041251 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:18.042079 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:18.042735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:18.043379 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lazy-loading 'fault' on Instance uuid 6657e20f-b2a0-4f01-9dca-fd276792dc73 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:21:18.100024 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:18.112275 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-198f8e14-24e5-419f-ba02-50e14e0d41a8 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 200 len: 1326 microversion: 2.1 time: 0.130999 Aug 30 01:21:18.113940 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 242/480] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:17 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:19.144602 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1b468b3a-189c-4f76-b69b-82bf42b3f636 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:19.145517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1b468b3a-189c-4f76-b69b-82bf42b3f636 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:19.155133 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b468b3a-189c-4f76-b69b-82bf42b3f636 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:19.155678 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b468b3a-189c-4f76-b69b-82bf42b3f636 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:19.156141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b468b3a-189c-4f76-b69b-82bf42b3f636 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:19.156909 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b468b3a-189c-4f76-b69b-82bf42b3f636 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:19.157378 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b468b3a-189c-4f76-b69b-82bf42b3f636 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:19.158724 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b468b3a-189c-4f76-b69b-82bf42b3f636 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:19.177643 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-1b468b3a-189c-4f76-b69b-82bf42b3f636 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] HTTP exception thrown: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1b468b3a-189c-4f76-b69b-82bf42b3f636 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Request method failure captured: Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 HTTP/1.1 Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWTxmiSmYqwnZa6dI51lhRZyg9VfWY5jMyqWbbiVTJDD_PMkAz0T3A8s2WrKUfgTsOAV_x2fzXXPp_brKmD04mnOtvXa-HrXzhr_IPfyR1M9WpjHFyf5zitccFqTf5eNw_zRZj9AF101W78_zLIKbLQSD9K9lbPWOwN34eRppA5vLJE Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: a69f2b2876ed47459a8b960ff679c724 Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:21:19.179481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:21:19.181233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:21:19.181233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:21:19.181233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: a69f2b2876ed47459a8b960ff679c724 Aug 30 01:21:19.181233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:21:19.181233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeTestJSON-706439447-project Aug 30 01:21:19.181233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:21:19.181233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:21:19.181233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: d5bd0cb311db42d7882a4cf90b0d85e8 Aug 30 01:21:19.181233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeTestJSON-706439447-project Aug 30 01:21:19.181233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:21:19.181233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:21:19.181233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '6657e20f-b2a0-4f01-9dca-fd276792dc73'} Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:21:19.182926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:21:19.184598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:21:19.185943 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1b468b3a-189c-4f76-b69b-82bf42b3f636 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Returning 404 to user: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:21:19.185943 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1b468b3a-189c-4f76-b69b-82bf42b3f636 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 404 len: 111 microversion: 2.1 time: 0.049272 Aug 30 01:21:19.188105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 239/481] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:19 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:21:19.199561 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-dd340560-d992-42a4-93ae-0b13c7f67d2d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '.version_select at 0x7ff48acf48b0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:19.235941 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-dd340560-d992-42a4-93ae-0b13c7f67d2d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-859645508" status: 202 len: 0 microversion: 2.1 time: 0.046333 Aug 30 01:21:19.237379 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 243/482] 10.222.0.44 () {58 vars in 1218 bytes} [Tue Aug 30 01:21:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-859645508 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:21:19.914335 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1f602949-b15e-403c-811c-c5d6f217ad21 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Action: 'create', calling method: .version_select at 0x7ff48adb0160>, body: {"keypair": {"name": "tempest-keypair-567082676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeeoYke40Fw5XA03u+OzZBQUnqjqsHlT1/DM7BoxXRJCOZPM34HnsBWU0w9dwLQ+g30c4yW7gMYZ9BhGnZPyG1h80DbWLqNbB8DE5RNTpRzl8Ez15z+lPJUmXRW3qFkFA=="}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:19.933706 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-1f602949-b15e-403c-811c-c5d6f217ad21 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Getting quotas for project a69f2b2876ed47459a8b960ff679c724. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:21:19.939892 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-1f602949-b15e-403c-811c-c5d6f217ad21 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Getting quotas for user d5bd0cb311db42d7882a4cf90b0d85e8 and project a69f2b2876ed47459a8b960ff679c724. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:21:19.966415 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1f602949-b15e-403c-811c-c5d6f217ad21 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056004 Aug 30 01:21:19.967365 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 240/483] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Aug 30 01:21:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:21.301048 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1319594207", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8469c42-cfe3-468a-82da-a1b36c332c12"}], "security_groups": [{"name": "tempest-securitygroup--411123702"}], "key_name": "tempest-keypair-567082676", "user_data": "}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:21.416371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] validate_networks() for [('b8469c42-cfe3-468a-82da-a1b36c332c12', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:21:21.816697 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:21:21.817149 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:21:21.817623 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:21:21.818036 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:21:21.818445 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:21:21.828858 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:21.829895 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:21.830529 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:21.831419 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:21.831880 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:21.832346 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:21.852304 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Getting quotas for project a69f2b2876ed47459a8b960ff679c724. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:21:21.857253 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Getting quotas for user d5bd0cb311db42d7882a4cf90b0d85e8 and project a69f2b2876ed47459a8b960ff679c724. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:21:21.871557 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:21:21.874148 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:21:21.926439 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3204ccab-a328-4e7d-86fa-de0b52bf0d12 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.630346 Aug 30 01:21:21.927366 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 244/484] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:21:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:21:21.939399 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c73ea6ed-1535-464a-8464-6d1594f16741 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:21.940421 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c73ea6ed-1535-464a-8464-6d1594f16741 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:22.003906 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c73ea6ed-1535-464a-8464-6d1594f16741 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:22.012058 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c73ea6ed-1535-464a-8464-6d1594f16741 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1237 microversion: 2.1 time: 0.077623 Aug 30 01:21:22.012625 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 241/485] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:21 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:23.036014 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e4d0b245-200e-4924-a0ba-c57eba53e8c2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:23.036694 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e4d0b245-200e-4924-a0ba-c57eba53e8c2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:23.043150 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e4d0b245-200e-4924-a0ba-c57eba53e8c2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:23.043634 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e4d0b245-200e-4924-a0ba-c57eba53e8c2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:23.044090 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e4d0b245-200e-4924-a0ba-c57eba53e8c2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:23.044799 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e4d0b245-200e-4924-a0ba-c57eba53e8c2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:23.045245 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e4d0b245-200e-4924-a0ba-c57eba53e8c2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:23.045663 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e4d0b245-200e-4924-a0ba-c57eba53e8c2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:23.112036 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e4d0b245-200e-4924-a0ba-c57eba53e8c2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:23.120437 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e4d0b245-200e-4924-a0ba-c57eba53e8c2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1289 microversion: 2.1 time: 0.089342 Aug 30 01:21:23.121018 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 245/486] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:23 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:24.146096 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-437b0173-7fbf-4551-a47a-2a828ea74a3a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:24.146821 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-437b0173-7fbf-4551-a47a-2a828ea74a3a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:24.154186 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-437b0173-7fbf-4551-a47a-2a828ea74a3a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:24.154781 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-437b0173-7fbf-4551-a47a-2a828ea74a3a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:24.155286 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-437b0173-7fbf-4551-a47a-2a828ea74a3a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:24.156606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-437b0173-7fbf-4551-a47a-2a828ea74a3a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:24.156606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-437b0173-7fbf-4551-a47a-2a828ea74a3a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:24.157068 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-437b0173-7fbf-4551-a47a-2a828ea74a3a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:24.414235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-437b0173-7fbf-4551-a47a-2a828ea74a3a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:24.421922 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-437b0173-7fbf-4551-a47a-2a828ea74a3a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1362 microversion: 2.1 time: 0.280860 Aug 30 01:21:24.422749 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 242/487] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:24 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:24.749030 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-827c2eac-2377-4b2b-befa-2e47b45cd4f9 req-9189a7ec-c8aa-4f72-909d-0215f26ac223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c71a84e-dc40-4fe0-a125-b4dd1749396f", "tag": "337b409d-a296-4c2d-9a34-bab9e39b72c4"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:24.760483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-827c2eac-2377-4b2b-befa-2e47b45cd4f9 req-9189a7ec-c8aa-4f72-909d-0215f26ac223 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:24.761035 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-827c2eac-2377-4b2b-befa-2e47b45cd4f9 req-9189a7ec-c8aa-4f72-909d-0215f26ac223 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:24.761665 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-827c2eac-2377-4b2b-befa-2e47b45cd4f9 req-9189a7ec-c8aa-4f72-909d-0215f26ac223 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:24.773890 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-827c2eac-2377-4b2b-befa-2e47b45cd4f9 req-9189a7ec-c8aa-4f72-909d-0215f26ac223 service nova] Creating event network-changed:337b409d-a296-4c2d-9a34-bab9e39b72c4 for instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f on hv-cinder-81514 Aug 30 01:21:24.778962 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-827c2eac-2377-4b2b-befa-2e47b45cd4f9 req-9189a7ec-c8aa-4f72-909d-0215f26ac223 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034137 Aug 30 01:21:24.779666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 246/488] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:25.443445 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-94128fb7-1444-4ebc-9aae-3a4b5c84e0b2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:25.444092 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-94128fb7-1444-4ebc-9aae-3a4b5c84e0b2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:25.450827 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-94128fb7-1444-4ebc-9aae-3a4b5c84e0b2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:25.451311 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-94128fb7-1444-4ebc-9aae-3a4b5c84e0b2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:25.451747 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-94128fb7-1444-4ebc-9aae-3a4b5c84e0b2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:25.452476 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-94128fb7-1444-4ebc-9aae-3a4b5c84e0b2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:25.452926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-94128fb7-1444-4ebc-9aae-3a4b5c84e0b2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:25.453355 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-94128fb7-1444-4ebc-9aae-3a4b5c84e0b2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:25.584532 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-94128fb7-1444-4ebc-9aae-3a4b5c84e0b2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:25.592650 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-94128fb7-1444-4ebc-9aae-3a4b5c84e0b2 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1362 microversion: 2.1 time: 0.153153 Aug 30 01:21:25.593237 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 243/489] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:25 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:26.616494 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5713160e-3640-4f9e-bef4-1bdc4ef1dd03 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:26.617219 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5713160e-3640-4f9e-bef4-1bdc4ef1dd03 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:26.623920 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5713160e-3640-4f9e-bef4-1bdc4ef1dd03 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:26.624428 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5713160e-3640-4f9e-bef4-1bdc4ef1dd03 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:26.624852 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5713160e-3640-4f9e-bef4-1bdc4ef1dd03 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:26.625534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5713160e-3640-4f9e-bef4-1bdc4ef1dd03 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:26.625978 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5713160e-3640-4f9e-bef4-1bdc4ef1dd03 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:26.626397 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5713160e-3640-4f9e-bef4-1bdc4ef1dd03 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:26.961459 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5713160e-3640-4f9e-bef4-1bdc4ef1dd03 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:26.969068 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5713160e-3640-4f9e-bef4-1bdc4ef1dd03 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1362 microversion: 2.1 time: 0.358344 Aug 30 01:21:26.969638 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 247/490] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:26 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:27.989947 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9f16719e-a77a-4bda-870d-fc33f2dc53f0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:27.990561 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9f16719e-a77a-4bda-870d-fc33f2dc53f0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:27.997061 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f16719e-a77a-4bda-870d-fc33f2dc53f0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:27.997552 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f16719e-a77a-4bda-870d-fc33f2dc53f0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:27.998244 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f16719e-a77a-4bda-870d-fc33f2dc53f0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:27.998930 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f16719e-a77a-4bda-870d-fc33f2dc53f0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:27.999385 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f16719e-a77a-4bda-870d-fc33f2dc53f0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:27.999809 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f16719e-a77a-4bda-870d-fc33f2dc53f0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:28.196488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9f16719e-a77a-4bda-870d-fc33f2dc53f0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:28.204592 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9f16719e-a77a-4bda-870d-fc33f2dc53f0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1362 microversion: 2.1 time: 0.218463 Aug 30 01:21:28.205226 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 244/491] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:27 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:29.226680 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4b51fbd0-e180-4a9f-868a-f2949f0b5902 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:29.227284 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4b51fbd0-e180-4a9f-868a-f2949f0b5902 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:29.233942 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b51fbd0-e180-4a9f-868a-f2949f0b5902 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:29.234423 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b51fbd0-e180-4a9f-868a-f2949f0b5902 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:29.234855 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b51fbd0-e180-4a9f-868a-f2949f0b5902 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:29.235537 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b51fbd0-e180-4a9f-868a-f2949f0b5902 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:29.235985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b51fbd0-e180-4a9f-868a-f2949f0b5902 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:29.236432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b51fbd0-e180-4a9f-868a-f2949f0b5902 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:29.369239 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4b51fbd0-e180-4a9f-868a-f2949f0b5902 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:29.377723 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4b51fbd0-e180-4a9f-868a-f2949f0b5902 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1362 microversion: 2.1 time: 0.155690 Aug 30 01:21:29.378326 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 248/492] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:29 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:29.414312 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bbe74380-1eaa-49de-a012-7728a4a73492 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:29.414873 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bbe74380-1eaa-49de-a012-7728a4a73492 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:29.421285 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbe74380-1eaa-49de-a012-7728a4a73492 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:29.421761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbe74380-1eaa-49de-a012-7728a4a73492 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:29.422191 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbe74380-1eaa-49de-a012-7728a4a73492 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:29.422877 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbe74380-1eaa-49de-a012-7728a4a73492 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:29.423323 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbe74380-1eaa-49de-a012-7728a4a73492 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:29.423742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbe74380-1eaa-49de-a012-7728a4a73492 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:29.509046 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-bbe74380-1eaa-49de-a012-7728a4a73492 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lazy-loading 'services' on Instance uuid 9f6ce1c9-bac7-4653-8051-123c152ed7df {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:21:29.584197 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bbe74380-1eaa-49de-a012-7728a4a73492 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-volume_attachments/47569380-a4e0-40e2-80c9-61f8f4a65d2a" status: 202 len: 0 microversion: 2.1 time: 0.173563 Aug 30 01:21:29.584922 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 245/493] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Aug 30 01:21:29 2022] DELETE /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-volume_attachments/47569380-a4e0-40e2-80c9-61f8f4a65d2a => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:21:29.593722 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ab632fea-19b1-460a-b1f3-da1726ee906e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:29.596266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ab632fea-19b1-460a-b1f3-da1726ee906e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:29.604522 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab632fea-19b1-460a-b1f3-da1726ee906e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:29.605022 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab632fea-19b1-460a-b1f3-da1726ee906e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:29.605463 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab632fea-19b1-460a-b1f3-da1726ee906e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:29.606327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab632fea-19b1-460a-b1f3-da1726ee906e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:29.606784 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab632fea-19b1-460a-b1f3-da1726ee906e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:29.607206 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab632fea-19b1-460a-b1f3-da1726ee906e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:29.640332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ab632fea-19b1-460a-b1f3-da1726ee906e tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050803 Aug 30 01:21:29.640909 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 249/494] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:21:29 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:30.400972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8e409956-dcfb-485d-8780-436292a89134 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:30.401567 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8e409956-dcfb-485d-8780-436292a89134 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:30.407967 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e409956-dcfb-485d-8780-436292a89134 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:30.408511 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e409956-dcfb-485d-8780-436292a89134 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:30.408942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e409956-dcfb-485d-8780-436292a89134 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:30.409633 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e409956-dcfb-485d-8780-436292a89134 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:30.410104 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e409956-dcfb-485d-8780-436292a89134 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:30.411085 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e409956-dcfb-485d-8780-436292a89134 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:30.626166 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8e409956-dcfb-485d-8780-436292a89134 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:30.634948 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8e409956-dcfb-485d-8780-436292a89134 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1362 microversion: 2.1 time: 0.238595 Aug 30 01:21:30.635574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 246/495] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:30 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:30.655842 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a9a642a7-7aab-4497-89bf-4b53db0a59f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:30.659239 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a9a642a7-7aab-4497-89bf-4b53db0a59f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:30.666963 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a9a642a7-7aab-4497-89bf-4b53db0a59f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:30.667675 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a9a642a7-7aab-4497-89bf-4b53db0a59f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:30.668299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a9a642a7-7aab-4497-89bf-4b53db0a59f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:30.670087 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a9a642a7-7aab-4497-89bf-4b53db0a59f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:30.670700 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a9a642a7-7aab-4497-89bf-4b53db0a59f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:30.671285 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a9a642a7-7aab-4497-89bf-4b53db0a59f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:30.704247 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-a5966b5c-5baf-4f0a-817a-846e3cf237ce req-3290c91b-246f-44d7-93c7-2c9424ff7fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c71a84e-dc40-4fe0-a125-b4dd1749396f", "name": "network-vif-plugged", "status": "completed", "tag": "337b409d-a296-4c2d-9a34-bab9e39b72c4"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:30.725039 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a5966b5c-5baf-4f0a-817a-846e3cf237ce req-3290c91b-246f-44d7-93c7-2c9424ff7fd8 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:30.725388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a9a642a7-7aab-4497-89bf-4b53db0a59f0 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073550 Aug 30 01:21:30.725951 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a5966b5c-5baf-4f0a-817a-846e3cf237ce req-3290c91b-246f-44d7-93c7-2c9424ff7fd8 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:30.726089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 250/496] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:21:30 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:21:30.726778 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a5966b5c-5baf-4f0a-817a-846e3cf237ce req-3290c91b-246f-44d7-93c7-2c9424ff7fd8 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:30.739142 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-a5966b5c-5baf-4f0a-817a-846e3cf237ce req-3290c91b-246f-44d7-93c7-2c9424ff7fd8 service nova] Creating event network-vif-plugged:337b409d-a296-4c2d-9a34-bab9e39b72c4 for instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f on hv-cinder-81514 Aug 30 01:21:30.745380 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-a5966b5c-5baf-4f0a-817a-846e3cf237ce req-3290c91b-246f-44d7-93c7-2c9424ff7fd8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044956 Aug 30 01:21:30.746175 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 247/497] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:21:30.802620 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-46a8c63d-f232-4ac7-a684-14c821e200b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:30.803335 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-46a8c63d-f232-4ac7-a684-14c821e200b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:30.809650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46a8c63d-f232-4ac7-a684-14c821e200b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:30.810134 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46a8c63d-f232-4ac7-a684-14c821e200b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:30.810590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46a8c63d-f232-4ac7-a684-14c821e200b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:30.811305 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46a8c63d-f232-4ac7-a684-14c821e200b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:30.811925 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46a8c63d-f232-4ac7-a684-14c821e200b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:30.812380 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46a8c63d-f232-4ac7-a684-14c821e200b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:30.840535 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-46a8c63d-f232-4ac7-a684-14c821e200b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:21:30.927783 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-46a8c63d-f232-4ac7-a684-14c821e200b1 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 204 len: 0 microversion: 2.1 time: 0.129526 Aug 30 01:21:30.928591 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 251/498] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:21:30 2022] DELETE /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:21:30.937275 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3043c143-42da-484a-a727-22551559a922 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:30.938305 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3043c143-42da-484a-a727-22551559a922 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:30.946318 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3043c143-42da-484a-a727-22551559a922 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:30.947002 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3043c143-42da-484a-a727-22551559a922 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:30.947424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3043c143-42da-484a-a727-22551559a922 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:30.948181 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3043c143-42da-484a-a727-22551559a922 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:30.948640 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3043c143-42da-484a-a727-22551559a922 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:30.949077 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3043c143-42da-484a-a727-22551559a922 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:31.093800 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3043c143-42da-484a-a727-22551559a922 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:31.102419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3043c143-42da-484a-a727-22551559a922 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1690 microversion: 2.1 time: 0.169271 Aug 30 01:21:31.102993 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 248/499] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:30 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:31.660298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-df4a7783-8167-4d8f-9e1a-7a4a4b9a1a26 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:31.661103 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-df4a7783-8167-4d8f-9e1a-7a4a4b9a1a26 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:31.667708 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df4a7783-8167-4d8f-9e1a-7a4a4b9a1a26 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:31.668176 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df4a7783-8167-4d8f-9e1a-7a4a4b9a1a26 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:31.668606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df4a7783-8167-4d8f-9e1a-7a4a4b9a1a26 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:31.669287 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df4a7783-8167-4d8f-9e1a-7a4a4b9a1a26 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:31.669795 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df4a7783-8167-4d8f-9e1a-7a4a4b9a1a26 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:31.670295 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df4a7783-8167-4d8f-9e1a-7a4a4b9a1a26 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:31.811201 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-df4a7783-8167-4d8f-9e1a-7a4a4b9a1a26 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:31.819323 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-df4a7783-8167-4d8f-9e1a-7a4a4b9a1a26 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1362 microversion: 2.1 time: 0.164520 Aug 30 01:21:31.819884 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 252/500] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:31 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:32.124613 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-09c8ba2f-d324-4ad7-bb17-60768661b67b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:32.125227 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-09c8ba2f-d324-4ad7-bb17-60768661b67b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:32.127665 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:32.133873 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09c8ba2f-d324-4ad7-bb17-60768661b67b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:32.134362 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09c8ba2f-d324-4ad7-bb17-60768661b67b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:32.134812 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09c8ba2f-d324-4ad7-bb17-60768661b67b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:32.135504 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09c8ba2f-d324-4ad7-bb17-60768661b67b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:32.135975 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09c8ba2f-d324-4ad7-bb17-60768661b67b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:32.136422 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09c8ba2f-d324-4ad7-bb17-60768661b67b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:32.273097 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-09c8ba2f-d324-4ad7-bb17-60768661b67b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:32.282008 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-09c8ba2f-d324-4ad7-bb17-60768661b67b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1690 microversion: 2.1 time: 0.161577 Aug 30 01:21:32.282589 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 249/501] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:32 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:32.840905 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-13cbdf97-1e04-4dd5-8cbb-94dafa371564 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:32.841514 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-13cbdf97-1e04-4dd5-8cbb-94dafa371564 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:32.843488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:32.844193 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:32.851862 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13cbdf97-1e04-4dd5-8cbb-94dafa371564 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:32.852497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13cbdf97-1e04-4dd5-8cbb-94dafa371564 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:32.852937 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13cbdf97-1e04-4dd5-8cbb-94dafa371564 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:32.853638 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13cbdf97-1e04-4dd5-8cbb-94dafa371564 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:32.854090 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13cbdf97-1e04-4dd5-8cbb-94dafa371564 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:32.854512 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13cbdf97-1e04-4dd5-8cbb-94dafa371564 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:32.986000 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-13cbdf97-1e04-4dd5-8cbb-94dafa371564 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:32.989835 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:32.994997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-13cbdf97-1e04-4dd5-8cbb-94dafa371564 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1362 microversion: 2.1 time: 0.157968 Aug 30 01:21:32.995569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 253/502] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:32 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:33.304149 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e254c80d-ddc6-44e4-b5f4-d5ae4321045f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:33.304798 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e254c80d-ddc6-44e4-b5f4-d5ae4321045f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:33.311200 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e254c80d-ddc6-44e4-b5f4-d5ae4321045f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:33.311671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e254c80d-ddc6-44e4-b5f4-d5ae4321045f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:33.312127 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e254c80d-ddc6-44e4-b5f4-d5ae4321045f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:33.312810 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e254c80d-ddc6-44e4-b5f4-d5ae4321045f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:33.313250 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e254c80d-ddc6-44e4-b5f4-d5ae4321045f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:33.313664 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e254c80d-ddc6-44e4-b5f4-d5ae4321045f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:33.448261 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e254c80d-ddc6-44e4-b5f4-d5ae4321045f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:33.456302 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e254c80d-ddc6-44e4-b5f4-d5ae4321045f tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1690 microversion: 2.1 time: 0.156948 Aug 30 01:21:33.457403 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 250/503] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:33 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:34.072517 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8665b51b-6fbb-477d-a32a-ccaf71a71a80 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:34.073201 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8665b51b-6fbb-477d-a32a-ccaf71a71a80 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:34.079673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8665b51b-6fbb-477d-a32a-ccaf71a71a80 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:34.080181 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8665b51b-6fbb-477d-a32a-ccaf71a71a80 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:34.080613 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8665b51b-6fbb-477d-a32a-ccaf71a71a80 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:34.081297 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8665b51b-6fbb-477d-a32a-ccaf71a71a80 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:34.081766 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8665b51b-6fbb-477d-a32a-ccaf71a71a80 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:34.082183 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8665b51b-6fbb-477d-a32a-ccaf71a71a80 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:34.216423 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8665b51b-6fbb-477d-a32a-ccaf71a71a80 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:34.224779 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8665b51b-6fbb-477d-a32a-ccaf71a71a80 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1362 microversion: 2.1 time: 0.211877 Aug 30 01:21:34.225342 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 254/504] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:34 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:34.392389 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c760c7f2-9119-47fb-8cc2-19d6ebef2b89 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:34.395304 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c760c7f2-9119-47fb-8cc2-19d6ebef2b89 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:34.401867 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c760c7f2-9119-47fb-8cc2-19d6ebef2b89 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:34.402358 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c760c7f2-9119-47fb-8cc2-19d6ebef2b89 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:34.402825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c760c7f2-9119-47fb-8cc2-19d6ebef2b89 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:34.403520 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c760c7f2-9119-47fb-8cc2-19d6ebef2b89 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:34.403974 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c760c7f2-9119-47fb-8cc2-19d6ebef2b89 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:34.404441 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c760c7f2-9119-47fb-8cc2-19d6ebef2b89 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:34.477043 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c760c7f2-9119-47fb-8cc2-19d6ebef2b89 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "POST /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/action" status: 202 len: 0 microversion: 2.1 time: 0.088386 Aug 30 01:21:34.477789 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 251/505] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:21:34 2022] POST /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:21:34.482443 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fa8c3430-19d2-4b16-8804-202c354d0bf5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:34.483242 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fa8c3430-19d2-4b16-8804-202c354d0bf5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:34.487350 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-35cd4339-bae0-4f5e-946b-a1dcd58bd941 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:34.488627 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-35cd4339-bae0-4f5e-946b-a1dcd58bd941 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:34.490409 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fa8c3430-19d2-4b16-8804-202c354d0bf5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:34.490901 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fa8c3430-19d2-4b16-8804-202c354d0bf5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:34.491347 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fa8c3430-19d2-4b16-8804-202c354d0bf5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:34.492073 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fa8c3430-19d2-4b16-8804-202c354d0bf5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:34.492560 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fa8c3430-19d2-4b16-8804-202c354d0bf5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:34.492985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fa8c3430-19d2-4b16-8804-202c354d0bf5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:34.494863 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35cd4339-bae0-4f5e-946b-a1dcd58bd941 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:34.495344 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35cd4339-bae0-4f5e-946b-a1dcd58bd941 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:34.495788 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35cd4339-bae0-4f5e-946b-a1dcd58bd941 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:34.496501 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35cd4339-bae0-4f5e-946b-a1dcd58bd941 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:34.496954 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35cd4339-bae0-4f5e-946b-a1dcd58bd941 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:34.497374 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35cd4339-bae0-4f5e-946b-a1dcd58bd941 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:34.627495 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fa8c3430-19d2-4b16-8804-202c354d0bf5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:34.635932 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fa8c3430-19d2-4b16-8804-202c354d0bf5 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1690 microversion: 2.1 time: 0.160014 Aug 30 01:21:34.636537 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 255/506] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:34 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:34.646073 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-35cd4339-bae0-4f5e-946b-a1dcd58bd941 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:34.654880 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-35cd4339-bae0-4f5e-946b-a1dcd58bd941 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1752 microversion: 2.1 time: 0.171528 Aug 30 01:21:34.655437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 252/507] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:34 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:35.245374 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3d137dbc-01fb-4e7b-9616-60c5a4028e15 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:35.246045 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3d137dbc-01fb-4e7b-9616-60c5a4028e15 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:35.252816 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3d137dbc-01fb-4e7b-9616-60c5a4028e15 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:35.253370 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3d137dbc-01fb-4e7b-9616-60c5a4028e15 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:35.254051 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3d137dbc-01fb-4e7b-9616-60c5a4028e15 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:35.254745 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3d137dbc-01fb-4e7b-9616-60c5a4028e15 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:35.255190 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3d137dbc-01fb-4e7b-9616-60c5a4028e15 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:35.255605 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3d137dbc-01fb-4e7b-9616-60c5a4028e15 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:35.430874 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3d137dbc-01fb-4e7b-9616-60c5a4028e15 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:35.438956 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3d137dbc-01fb-4e7b-9616-60c5a4028e15 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1362 microversion: 2.1 time: 0.197451 Aug 30 01:21:35.439693 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 256/508] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:35 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:35.657851 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-416f1320-39a9-4ba4-b27b-3596729fc5f2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:35.658459 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-416f1320-39a9-4ba4-b27b-3596729fc5f2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:35.665407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-416f1320-39a9-4ba4-b27b-3596729fc5f2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:35.665881 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-416f1320-39a9-4ba4-b27b-3596729fc5f2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:35.666314 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-416f1320-39a9-4ba4-b27b-3596729fc5f2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:35.666999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-416f1320-39a9-4ba4-b27b-3596729fc5f2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:35.667451 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-416f1320-39a9-4ba4-b27b-3596729fc5f2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:35.667863 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-416f1320-39a9-4ba4-b27b-3596729fc5f2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:35.677700 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0d6569b5-739c-4b61-8d44-c6dfdead99db tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:35.678479 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0d6569b5-739c-4b61-8d44-c6dfdead99db tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:35.685348 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0d6569b5-739c-4b61-8d44-c6dfdead99db tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:35.685963 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0d6569b5-739c-4b61-8d44-c6dfdead99db tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:35.686202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0d6569b5-739c-4b61-8d44-c6dfdead99db tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:35.689987 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0d6569b5-739c-4b61-8d44-c6dfdead99db tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:35.689987 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0d6569b5-739c-4b61-8d44-c6dfdead99db tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:35.689987 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0d6569b5-739c-4b61-8d44-c6dfdead99db tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:35.816933 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-416f1320-39a9-4ba4-b27b-3596729fc5f2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:35.824539 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-416f1320-39a9-4ba4-b27b-3596729fc5f2 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1690 microversion: 2.1 time: 0.170507 Aug 30 01:21:35.825116 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 253/509] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:35 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:35.842625 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0d6569b5-739c-4b61-8d44-c6dfdead99db tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:35.851087 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0d6569b5-739c-4b61-8d44-c6dfdead99db tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1752 microversion: 2.1 time: 0.177595 Aug 30 01:21:35.851651 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 257/510] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:35 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:36.461378 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7c255559-a1df-4acf-ba34-11293e7c4b83 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:36.461944 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7c255559-a1df-4acf-ba34-11293e7c4b83 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:36.480549 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c255559-a1df-4acf-ba34-11293e7c4b83 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:36.481067 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c255559-a1df-4acf-ba34-11293e7c4b83 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:36.481557 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c255559-a1df-4acf-ba34-11293e7c4b83 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:36.482358 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c255559-a1df-4acf-ba34-11293e7c4b83 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:36.482827 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c255559-a1df-4acf-ba34-11293e7c4b83 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:36.483296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c255559-a1df-4acf-ba34-11293e7c4b83 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:36.732868 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7c255559-a1df-4acf-ba34-11293e7c4b83 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:36.740759 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7c255559-a1df-4acf-ba34-11293e7c4b83 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1548 microversion: 2.1 time: 0.283225 Aug 30 01:21:36.752527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 254/511] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:36 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1548 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:36.765008 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e6335527-1c92-4c5c-b852-20a31150658b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:36.765491 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e6335527-1c92-4c5c-b852-20a31150658b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:36.773342 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e6335527-1c92-4c5c-b852-20a31150658b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:36.773823 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e6335527-1c92-4c5c-b852-20a31150658b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:36.774254 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e6335527-1c92-4c5c-b852-20a31150658b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:36.774949 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e6335527-1c92-4c5c-b852-20a31150658b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:36.775391 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e6335527-1c92-4c5c-b852-20a31150658b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:36.776079 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e6335527-1c92-4c5c-b852-20a31150658b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:36.848788 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1e56f2d1-2445-49c0-9ae7-d5df29a07298 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:36.849776 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1e56f2d1-2445-49c0-9ae7-d5df29a07298 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:36.860408 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e56f2d1-2445-49c0-9ae7-d5df29a07298 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:36.860980 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e56f2d1-2445-49c0-9ae7-d5df29a07298 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:36.862074 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e56f2d1-2445-49c0-9ae7-d5df29a07298 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:36.864470 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e56f2d1-2445-49c0-9ae7-d5df29a07298 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:36.865190 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e56f2d1-2445-49c0-9ae7-d5df29a07298 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:36.866483 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e56f2d1-2445-49c0-9ae7-d5df29a07298 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:36.877466 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e6335527-1c92-4c5c-b852-20a31150658b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116049 Aug 30 01:21:36.878620 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 258/512] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Aug 30 01:21:36 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:36.884016 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bed91b88-3a46-46cb-ae1b-af189a9503f1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:36.885039 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bed91b88-3a46-46cb-ae1b-af189a9503f1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:36.895900 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bed91b88-3a46-46cb-ae1b-af189a9503f1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:36.904152 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bed91b88-3a46-46cb-ae1b-af189a9503f1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:36.904980 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bed91b88-3a46-46cb-ae1b-af189a9503f1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:36.905899 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bed91b88-3a46-46cb-ae1b-af189a9503f1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:36.906358 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bed91b88-3a46-46cb-ae1b-af189a9503f1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:36.906937 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bed91b88-3a46-46cb-ae1b-af189a9503f1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:37.022168 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1e56f2d1-2445-49c0-9ae7-d5df29a07298 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:37.030586 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1e56f2d1-2445-49c0-9ae7-d5df29a07298 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1622 microversion: 2.1 time: 0.188244 Aug 30 01:21:37.031313 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 255/513] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:36 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1622 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:37.125576 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bed91b88-3a46-46cb-ae1b-af189a9503f1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:37.137464 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bed91b88-3a46-46cb-ae1b-af189a9503f1 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1757 microversion: 2.1 time: 0.257093 Aug 30 01:21:37.143164 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 259/514] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:36 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1757 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:37.271192 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-a32b9ff9-1cf1-4b71-9465-2a69d373678b req-0498537f-a4b1-4010-92fe-18ff7efae1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6ce1c9-bac7-4653-8051-123c152ed7df", "name": "network-vif-deleted", "tag": "4c098562-e7ad-4247-be8d-fe3c6317e383"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:37.299090 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a32b9ff9-1cf1-4b71-9465-2a69d373678b req-0498537f-a4b1-4010-92fe-18ff7efae1a4 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:37.302885 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a32b9ff9-1cf1-4b71-9465-2a69d373678b req-0498537f-a4b1-4010-92fe-18ff7efae1a4 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:37.304485 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a32b9ff9-1cf1-4b71-9465-2a69d373678b req-0498537f-a4b1-4010-92fe-18ff7efae1a4 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:37.320831 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-a32b9ff9-1cf1-4b71-9465-2a69d373678b req-0498537f-a4b1-4010-92fe-18ff7efae1a4 service nova] Creating event network-vif-deleted:4c098562-e7ad-4247-be8d-fe3c6317e383 for instance 9f6ce1c9-bac7-4653-8051-123c152ed7df on hv-cinder-81514 Aug 30 01:21:37.327747 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-a32b9ff9-1cf1-4b71-9465-2a69d373678b req-0498537f-a4b1-4010-92fe-18ff7efae1a4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062190 Aug 30 01:21:37.329230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 256/515] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:38.054248 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:38.055176 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:38.061463 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:38.063634 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:38.066817 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:38.067682 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:38.069351 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:38.072202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:38.073076 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:38.126163 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:38.127092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:38.127706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:38.129757 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lazy-loading 'fault' on Instance uuid 9f6ce1c9-bac7-4653-8051-123c152ed7df {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:21:38.161938 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f8658eaa-97b7-4cae-a37d-a32ab50a40a8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:38.163385 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f8658eaa-97b7-4cae-a37d-a32ab50a40a8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:38.174291 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8658eaa-97b7-4cae-a37d-a32ab50a40a8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:38.176323 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8658eaa-97b7-4cae-a37d-a32ab50a40a8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:38.177220 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8658eaa-97b7-4cae-a37d-a32ab50a40a8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:38.181943 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8658eaa-97b7-4cae-a37d-a32ab50a40a8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:38.181943 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8658eaa-97b7-4cae-a37d-a32ab50a40a8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:38.181943 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8658eaa-97b7-4cae-a37d-a32ab50a40a8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:38.214672 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:38.223833 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0ab6e8f5-a87e-4256-bc79-4914b2c053cb tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 200 len: 1336 microversion: 2.1 time: 0.174671 Aug 30 01:21:38.224682 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 260/516] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:38 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 1336 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:38.480732 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f8658eaa-97b7-4cae-a37d-a32ab50a40a8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:38.491381 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:38.497869 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f8658eaa-97b7-4cae-a37d-a32ab50a40a8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1757 microversion: 2.1 time: 0.341110 Aug 30 01:21:38.498977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 257/517] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:38 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1757 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:39.246799 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b88ebe9e-8093-470f-87cb-cefb55e511b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:39.247577 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b88ebe9e-8093-470f-87cb-cefb55e511b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 9f6ce1c9-bac7-4653-8051-123c152ed7df] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:39.253667 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b88ebe9e-8093-470f-87cb-cefb55e511b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:39.254153 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b88ebe9e-8093-470f-87cb-cefb55e511b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:39.254586 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b88ebe9e-8093-470f-87cb-cefb55e511b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:39.255270 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b88ebe9e-8093-470f-87cb-cefb55e511b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:39.255720 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b88ebe9e-8093-470f-87cb-cefb55e511b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:39.256176 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b88ebe9e-8093-470f-87cb-cefb55e511b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:39.269763 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-b88ebe9e-8093-470f-87cb-cefb55e511b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] HTTP exception thrown: Instance 9f6ce1c9-bac7-4653-8051-123c152ed7df could not be found. Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b88ebe9e-8093-470f-87cb-cefb55e511b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Request method failure captured: Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df HTTP/1.1 Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWTyu2mYlr5SZBPqmuxeReqX8oUXqakHxF2IKof-fnI3tzgBe6Mk-AUTjC6A0JXOa4T6LtGD53koWf8oxieYjCOwBXRn6eJa2ckFuh7HaVg-Gba7cj6y-mZqMkJD3n-WhL5eNJRIXpizs-TyaFCR-XXy3d0GgG2JzExm_2cHDwfdcWE Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: adf47975f465467498be24ebe2c81ad7 Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:21:39.271432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:21:39.273070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_adf47975f465467498be24ebe2c81ad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:21:39.273070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:21:39.273070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: adf47975f465467498be24ebe2c81ad7 Aug 30 01:21:39.273070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:21:39.273070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-ServerRescueNegativeTestJSON-1122969509-project Aug 30 01:21:39.273070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:21:39.273070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:21:39.273070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 6d5a0cf37e3b4d3084a178f83642c144 Aug 30 01:21:39.273070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1122969509-project Aug 30 01:21:39.273070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:21:39.273070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 9f6ce1c9-bac7-4653-8051-123c152ed7df could not be found. Aug 30 01:21:39.273070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '9f6ce1c9-bac7-4653-8051-123c152ed7df'} Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f6ce1c9-bac7-4653-8051-123c152ed7df could not be found. Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:21:39.273997 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f6ce1c9-bac7-4653-8051-123c152ed7df could not be found. Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f6ce1c9-bac7-4653-8051-123c152ed7df could not be found. Aug 30 01:21:39.275872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:39.277677 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b88ebe9e-8093-470f-87cb-cefb55e511b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Returning 404 to user: Instance 9f6ce1c9-bac7-4653-8051-123c152ed7df could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:21:39.277677 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b88ebe9e-8093-470f-87cb-cefb55e511b6 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df" status: 404 len: 111 microversion: 2.1 time: 0.030017 Aug 30 01:21:39.277677 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 261/518] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:39 2022] GET /compute/v2.1/servers/9f6ce1c9-bac7-4653-8051-123c152ed7df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:21:39.281458 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6bed54b2-7cba-4e1c-8d85-a9030e0e0282 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '.version_select at 0x7ff48ae084c0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:39.305073 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6bed54b2-7cba-4e1c-8d85-a9030e0e0282 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1030540723" status: 202 len: 0 microversion: 2.1 time: 0.027307 Aug 30 01:21:39.305656 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 258/519] 10.222.0.44 () {58 vars in 1221 bytes} [Tue Aug 30 01:21:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1030540723 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:21:39.355814 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-34448028-b2f3-4bc6-9189-5f85a0dea375 req-d38f2b46-c230-43e9-acbc-b5211470cd70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c71a84e-dc40-4fe0-a125-b4dd1749396f", "tag": "337b409d-a296-4c2d-9a34-bab9e39b72c4"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:39.366482 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-34448028-b2f3-4bc6-9189-5f85a0dea375 req-d38f2b46-c230-43e9-acbc-b5211470cd70 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:39.366973 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-34448028-b2f3-4bc6-9189-5f85a0dea375 req-d38f2b46-c230-43e9-acbc-b5211470cd70 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:39.367412 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-34448028-b2f3-4bc6-9189-5f85a0dea375 req-d38f2b46-c230-43e9-acbc-b5211470cd70 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:39.381426 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-34448028-b2f3-4bc6-9189-5f85a0dea375 req-d38f2b46-c230-43e9-acbc-b5211470cd70 service nova] Creating event network-changed:337b409d-a296-4c2d-9a34-bab9e39b72c4 for instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f on hv-cinder-81514 Aug 30 01:21:39.387276 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-34448028-b2f3-4bc6-9189-5f85a0dea375 req-d38f2b46-c230-43e9-acbc-b5211470cd70 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035058 Aug 30 01:21:39.388465 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 262/520] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:39.522495 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-768d670f-cd13-45f6-b43c-e2e618efbe0d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:39.523524 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-768d670f-cd13-45f6-b43c-e2e618efbe0d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:39.531273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-768d670f-cd13-45f6-b43c-e2e618efbe0d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:39.532707 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-768d670f-cd13-45f6-b43c-e2e618efbe0d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:39.533509 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-768d670f-cd13-45f6-b43c-e2e618efbe0d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:39.534989 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-768d670f-cd13-45f6-b43c-e2e618efbe0d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:39.535660 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-768d670f-cd13-45f6-b43c-e2e618efbe0d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:39.536612 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-768d670f-cd13-45f6-b43c-e2e618efbe0d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:39.773690 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-768d670f-cd13-45f6-b43c-e2e618efbe0d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:39.791877 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-768d670f-cd13-45f6-b43c-e2e618efbe0d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1757 microversion: 2.1 time: 0.273950 Aug 30 01:21:39.793755 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 259/521] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:39 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1757 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:40.825229 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5db6eacb-1047-40a5-b716-5a91fb3b0d17 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:40.825959 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5db6eacb-1047-40a5-b716-5a91fb3b0d17 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:40.832754 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5db6eacb-1047-40a5-b716-5a91fb3b0d17 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:40.833242 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5db6eacb-1047-40a5-b716-5a91fb3b0d17 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:40.833679 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5db6eacb-1047-40a5-b716-5a91fb3b0d17 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:40.834372 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5db6eacb-1047-40a5-b716-5a91fb3b0d17 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:40.834830 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5db6eacb-1047-40a5-b716-5a91fb3b0d17 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:40.835259 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5db6eacb-1047-40a5-b716-5a91fb3b0d17 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:40.982933 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5db6eacb-1047-40a5-b716-5a91fb3b0d17 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:40.993642 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5db6eacb-1047-40a5-b716-5a91fb3b0d17 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1757 microversion: 2.1 time: 0.172484 Aug 30 01:21:40.994221 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 263/522] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:40 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:42.015647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d888c7f3-e32f-40be-8a47-ed60264bc9e6 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:42.016304 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d888c7f3-e32f-40be-8a47-ed60264bc9e6 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:42.019078 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:42.024966 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d888c7f3-e32f-40be-8a47-ed60264bc9e6 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:42.025443 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d888c7f3-e32f-40be-8a47-ed60264bc9e6 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:42.025870 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d888c7f3-e32f-40be-8a47-ed60264bc9e6 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:42.026557 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d888c7f3-e32f-40be-8a47-ed60264bc9e6 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:42.027005 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d888c7f3-e32f-40be-8a47-ed60264bc9e6 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:42.027419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d888c7f3-e32f-40be-8a47-ed60264bc9e6 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:42.181257 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d888c7f3-e32f-40be-8a47-ed60264bc9e6 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:42.190361 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d888c7f3-e32f-40be-8a47-ed60264bc9e6 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1757 microversion: 2.1 time: 0.178078 Aug 30 01:21:42.191007 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 260/523] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:42 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:42.307306 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9aa0be6f-2dd9-481c-8af1-60ac18cec4ce tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:42.307793 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9aa0be6f-2dd9-481c-8af1-60ac18cec4ce tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:42.314389 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9aa0be6f-2dd9-481c-8af1-60ac18cec4ce tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:42.315397 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9aa0be6f-2dd9-481c-8af1-60ac18cec4ce tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:42.316261 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9aa0be6f-2dd9-481c-8af1-60ac18cec4ce tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:42.316690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9aa0be6f-2dd9-481c-8af1-60ac18cec4ce tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:42.317136 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9aa0be6f-2dd9-481c-8af1-60ac18cec4ce tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:42.317555 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9aa0be6f-2dd9-481c-8af1-60ac18cec4ce tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:42.348141 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9aa0be6f-2dd9-481c-8af1-60ac18cec4ce tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:21:42.426589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9aa0be6f-2dd9-481c-8af1-60ac18cec4ce tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "DELETE /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 204 len: 0 microversion: 2.1 time: 0.122663 Aug 30 01:21:42.428056 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 264/524] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:21:42 2022] DELETE /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:21:42.435848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-05e20ff9-2c5c-4c6c-b14d-04867c69f54b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:42.436500 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-05e20ff9-2c5c-4c6c-b14d-04867c69f54b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:42.443560 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-05e20ff9-2c5c-4c6c-b14d-04867c69f54b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:42.444058 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-05e20ff9-2c5c-4c6c-b14d-04867c69f54b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:42.444490 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-05e20ff9-2c5c-4c6c-b14d-04867c69f54b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:42.445175 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-05e20ff9-2c5c-4c6c-b14d-04867c69f54b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:42.445618 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-05e20ff9-2c5c-4c6c-b14d-04867c69f54b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:42.446034 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-05e20ff9-2c5c-4c6c-b14d-04867c69f54b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:42.581102 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-05e20ff9-2c5c-4c6c-b14d-04867c69f54b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:42.591301 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-05e20ff9-2c5c-4c6c-b14d-04867c69f54b tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1508 microversion: 2.1 time: 0.159051 Aug 30 01:21:42.592177 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 261/525] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:42 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:43.212276 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-376d2902-e5c5-4d71-8abd-b66907779f7b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:43.212986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-376d2902-e5c5-4d71-8abd-b66907779f7b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:43.219120 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-376d2902-e5c5-4d71-8abd-b66907779f7b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:43.219599 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-376d2902-e5c5-4d71-8abd-b66907779f7b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:43.220067 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-376d2902-e5c5-4d71-8abd-b66907779f7b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:43.220793 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-376d2902-e5c5-4d71-8abd-b66907779f7b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:43.222062 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-376d2902-e5c5-4d71-8abd-b66907779f7b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:43.222593 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-376d2902-e5c5-4d71-8abd-b66907779f7b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:43.382077 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-376d2902-e5c5-4d71-8abd-b66907779f7b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:43.393883 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-376d2902-e5c5-4d71-8abd-b66907779f7b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1757 microversion: 2.1 time: 0.185087 Aug 30 01:21:43.394518 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 265/526] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:43 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:43.613892 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e1c746fc-b6fb-46c8-b2c9-0bebc29e3f26 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:43.614427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e1c746fc-b6fb-46c8-b2c9-0bebc29e3f26 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:43.620963 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1c746fc-b6fb-46c8-b2c9-0bebc29e3f26 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:43.621414 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1c746fc-b6fb-46c8-b2c9-0bebc29e3f26 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:43.622088 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1c746fc-b6fb-46c8-b2c9-0bebc29e3f26 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:43.622775 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1c746fc-b6fb-46c8-b2c9-0bebc29e3f26 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:43.623220 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1c746fc-b6fb-46c8-b2c9-0bebc29e3f26 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:43.623632 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1c746fc-b6fb-46c8-b2c9-0bebc29e3f26 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:43.754866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e1c746fc-b6fb-46c8-b2c9-0bebc29e3f26 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:43.762675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e1c746fc-b6fb-46c8-b2c9-0bebc29e3f26 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1508 microversion: 2.1 time: 0.153420 Aug 30 01:21:43.763242 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 262/527] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:43 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:44.417416 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-20e6cd46-83e0-426f-80df-5d75fa63dc0c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:44.417933 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-20e6cd46-83e0-426f-80df-5d75fa63dc0c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:44.425224 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-20e6cd46-83e0-426f-80df-5d75fa63dc0c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:44.425918 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-20e6cd46-83e0-426f-80df-5d75fa63dc0c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:44.426361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-20e6cd46-83e0-426f-80df-5d75fa63dc0c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:44.427063 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-20e6cd46-83e0-426f-80df-5d75fa63dc0c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:44.427518 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-20e6cd46-83e0-426f-80df-5d75fa63dc0c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:44.427945 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-20e6cd46-83e0-426f-80df-5d75fa63dc0c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:44.583300 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-20e6cd46-83e0-426f-80df-5d75fa63dc0c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:44.592086 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-20e6cd46-83e0-426f-80df-5d75fa63dc0c tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1757 microversion: 2.1 time: 0.178595 Aug 30 01:21:44.592703 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 266/528] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:44 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:44.782724 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-90fe6bef-5137-4895-b7d6-dc517ab59d52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:44.783639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-90fe6bef-5137-4895-b7d6-dc517ab59d52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:44.791096 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-90fe6bef-5137-4895-b7d6-dc517ab59d52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:44.791697 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-90fe6bef-5137-4895-b7d6-dc517ab59d52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:44.792218 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-90fe6bef-5137-4895-b7d6-dc517ab59d52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:44.792923 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-90fe6bef-5137-4895-b7d6-dc517ab59d52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:44.793377 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-90fe6bef-5137-4895-b7d6-dc517ab59d52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:44.793803 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-90fe6bef-5137-4895-b7d6-dc517ab59d52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:45.041472 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-90fe6bef-5137-4895-b7d6-dc517ab59d52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:45.050362 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-90fe6bef-5137-4895-b7d6-dc517ab59d52 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 200 len: 1508 microversion: 2.1 time: 0.271482 Aug 30 01:21:45.051319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 263/529] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:44 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:45.315921 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-4e73f8e1-8539-4284-b3a8-cc7d0d89ff13 req-69fbb580-fee2-40bf-9308-4276e046b167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda66a0c-f0fc-4e46-a037-960b2879678a", "name": "network-vif-deleted", "tag": "3eabc9c9-0fec-47b6-9f67-0d6d39d99fb5"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:45.325604 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-4e73f8e1-8539-4284-b3a8-cc7d0d89ff13 req-69fbb580-fee2-40bf-9308-4276e046b167 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:45.326079 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-4e73f8e1-8539-4284-b3a8-cc7d0d89ff13 req-69fbb580-fee2-40bf-9308-4276e046b167 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:45.326697 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-4e73f8e1-8539-4284-b3a8-cc7d0d89ff13 req-69fbb580-fee2-40bf-9308-4276e046b167 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:45.338912 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-4e73f8e1-8539-4284-b3a8-cc7d0d89ff13 req-69fbb580-fee2-40bf-9308-4276e046b167 service nova] Creating event network-vif-deleted:3eabc9c9-0fec-47b6-9f67-0d6d39d99fb5 for instance dda66a0c-f0fc-4e46-a037-960b2879678a on hv-cinder-81514 Aug 30 01:21:45.344216 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-4e73f8e1-8539-4284-b3a8-cc7d0d89ff13 req-69fbb580-fee2-40bf-9308-4276e046b167 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032817 Aug 30 01:21:45.344811 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 267/530] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:45.614979 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8b7751dd-9249-4d93-bf34-5a9cb6afeffa tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:45.615835 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8b7751dd-9249-4d93-bf34-5a9cb6afeffa tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:45.623162 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b7751dd-9249-4d93-bf34-5a9cb6afeffa tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:45.623800 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b7751dd-9249-4d93-bf34-5a9cb6afeffa tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:45.624505 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b7751dd-9249-4d93-bf34-5a9cb6afeffa tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:45.625440 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b7751dd-9249-4d93-bf34-5a9cb6afeffa tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:45.626110 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b7751dd-9249-4d93-bf34-5a9cb6afeffa tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:45.626720 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b7751dd-9249-4d93-bf34-5a9cb6afeffa tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:45.806447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8b7751dd-9249-4d93-bf34-5a9cb6afeffa tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:45.816700 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8b7751dd-9249-4d93-bf34-5a9cb6afeffa tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1757 microversion: 2.1 time: 0.206272 Aug 30 01:21:45.817337 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 264/531] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:45 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:46.073369 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-70e0319a-ed28-4668-b49f-9477d243ffbe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:46.074104 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-70e0319a-ed28-4668-b49f-9477d243ffbe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: dda66a0c-f0fc-4e46-a037-960b2879678a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:46.080438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70e0319a-ed28-4668-b49f-9477d243ffbe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:46.081563 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70e0319a-ed28-4668-b49f-9477d243ffbe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:46.082056 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70e0319a-ed28-4668-b49f-9477d243ffbe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:46.082834 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70e0319a-ed28-4668-b49f-9477d243ffbe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:46.083295 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70e0319a-ed28-4668-b49f-9477d243ffbe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:46.083724 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70e0319a-ed28-4668-b49f-9477d243ffbe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:46.098996 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-70e0319a-ed28-4668-b49f-9477d243ffbe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] HTTP exception thrown: Instance dda66a0c-f0fc-4e46-a037-960b2879678a could not be found. Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-70e0319a-ed28-4668-b49f-9477d243ffbe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Request method failure captured: Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a HTTP/1.1 Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWTyu2mYlr5SZBPqmuxeReqX8oUXqakHxF2IKof-fnI3tzgBe6Mk-AUTjC6A0JXOa4T6LtGD53koWf8oxieYjCOwBXRn6eJa2ckFuh7HaVg-Gba7cj6y-mZqMkJD3n-WhL5eNJRIXpizs-TyaFCR-XXy3d0GgG2JzExm_2cHDwfdcWE Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: adf47975f465467498be24ebe2c81ad7 Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:21:46.100699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:21:46.102299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_adf47975f465467498be24ebe2c81ad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:21:46.102299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:21:46.102299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: adf47975f465467498be24ebe2c81ad7 Aug 30 01:21:46.102299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:21:46.102299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-ServerRescueNegativeTestJSON-1122969509-project Aug 30 01:21:46.102299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:21:46.102299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:21:46.102299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 6d5a0cf37e3b4d3084a178f83642c144 Aug 30 01:21:46.102299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1122969509-project Aug 30 01:21:46.102299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:21:46.102299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance dda66a0c-f0fc-4e46-a037-960b2879678a could not be found. Aug 30 01:21:46.102299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': 'dda66a0c-f0fc-4e46-a037-960b2879678a'} Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda66a0c-f0fc-4e46-a037-960b2879678a could not be found. Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:21:46.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda66a0c-f0fc-4e46-a037-960b2879678a could not be found. Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda66a0c-f0fc-4e46-a037-960b2879678a could not be found. Aug 30 01:21:46.104473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:46.105521 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-70e0319a-ed28-4668-b49f-9477d243ffbe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Returning 404 to user: Instance dda66a0c-f0fc-4e46-a037-960b2879678a could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:21:46.105521 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-70e0319a-ed28-4668-b49f-9477d243ffbe tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a" status: 404 len: 111 microversion: 2.1 time: 0.034026 Aug 30 01:21:46.105521 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 268/532] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:46 2022] GET /compute/v2.1/servers/dda66a0c-f0fc-4e46-a037-960b2879678a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:21:46.111761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-af4566cd-3136-4de0-9fac-ccf8f07a48ee tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:46.112555 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-af4566cd-3136-4de0-9fac-ccf8f07a48ee tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:46.118947 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af4566cd-3136-4de0-9fac-ccf8f07a48ee tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:46.119509 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af4566cd-3136-4de0-9fac-ccf8f07a48ee tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:46.119942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af4566cd-3136-4de0-9fac-ccf8f07a48ee tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:46.120662 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af4566cd-3136-4de0-9fac-ccf8f07a48ee tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:46.121108 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af4566cd-3136-4de0-9fac-ccf8f07a48ee tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:46.121525 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af4566cd-3136-4de0-9fac-ccf8f07a48ee tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:46.150637 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-af4566cd-3136-4de0-9fac-ccf8f07a48ee tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:21:46.234184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-af4566cd-3136-4de0-9fac-ccf8f07a48ee tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "DELETE /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 204 len: 0 microversion: 2.1 time: 0.125649 Aug 30 01:21:46.235506 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 265/533] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:21:46 2022] DELETE /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:21:46.244920 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-089b2cf6-7456-408e-aaf0-ddee9290b61a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:46.245678 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-089b2cf6-7456-408e-aaf0-ddee9290b61a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:46.252313 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-089b2cf6-7456-408e-aaf0-ddee9290b61a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:46.253438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-089b2cf6-7456-408e-aaf0-ddee9290b61a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:46.253908 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-089b2cf6-7456-408e-aaf0-ddee9290b61a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:46.254618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-089b2cf6-7456-408e-aaf0-ddee9290b61a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:46.255320 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-089b2cf6-7456-408e-aaf0-ddee9290b61a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:46.255519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-089b2cf6-7456-408e-aaf0-ddee9290b61a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:46.395787 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-089b2cf6-7456-408e-aaf0-ddee9290b61a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:46.404190 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-089b2cf6-7456-408e-aaf0-ddee9290b61a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.163776 Aug 30 01:21:46.404805 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 269/534] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:46 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:46.838596 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d1005a80-a117-489d-8dbb-d61e9d2a1377 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:46.839283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d1005a80-a117-489d-8dbb-d61e9d2a1377 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:46.846076 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1005a80-a117-489d-8dbb-d61e9d2a1377 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:46.847294 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1005a80-a117-489d-8dbb-d61e9d2a1377 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:46.847771 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1005a80-a117-489d-8dbb-d61e9d2a1377 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:46.848521 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1005a80-a117-489d-8dbb-d61e9d2a1377 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:46.849011 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1005a80-a117-489d-8dbb-d61e9d2a1377 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:46.849442 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1005a80-a117-489d-8dbb-d61e9d2a1377 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:47.001797 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d1005a80-a117-489d-8dbb-d61e9d2a1377 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:47.010950 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d1005a80-a117-489d-8dbb-d61e9d2a1377 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1757 microversion: 2.1 time: 0.176533 Aug 30 01:21:47.011521 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 266/535] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:46 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:47.426657 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4fbea6bc-7475-4937-9d29-b81326b0f78a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:47.427483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4fbea6bc-7475-4937-9d29-b81326b0f78a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:47.434788 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4fbea6bc-7475-4937-9d29-b81326b0f78a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:47.435278 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4fbea6bc-7475-4937-9d29-b81326b0f78a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:47.435717 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4fbea6bc-7475-4937-9d29-b81326b0f78a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:47.436461 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4fbea6bc-7475-4937-9d29-b81326b0f78a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:47.436901 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4fbea6bc-7475-4937-9d29-b81326b0f78a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:47.437325 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4fbea6bc-7475-4937-9d29-b81326b0f78a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:47.569791 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4fbea6bc-7475-4937-9d29-b81326b0f78a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:47.577664 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4fbea6bc-7475-4937-9d29-b81326b0f78a tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.155600 Aug 30 01:21:47.578361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 270/536] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:47 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:48.032253 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cede6199-6f82-4fe5-b83d-6c80824ed1e4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:48.032798 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cede6199-6f82-4fe5-b83d-6c80824ed1e4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:48.040238 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cede6199-6f82-4fe5-b83d-6c80824ed1e4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:48.040743 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cede6199-6f82-4fe5-b83d-6c80824ed1e4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:48.041182 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cede6199-6f82-4fe5-b83d-6c80824ed1e4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:48.041924 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cede6199-6f82-4fe5-b83d-6c80824ed1e4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:48.042377 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cede6199-6f82-4fe5-b83d-6c80824ed1e4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:48.042805 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cede6199-6f82-4fe5-b83d-6c80824ed1e4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:48.198252 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cede6199-6f82-4fe5-b83d-6c80824ed1e4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:48.207384 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cede6199-6f82-4fe5-b83d-6c80824ed1e4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1757 microversion: 2.1 time: 0.179050 Aug 30 01:21:48.207960 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 267/537] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:48 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:48.599452 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-29952499-0080-40da-8547-0e81a35f9246 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:48.600110 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-29952499-0080-40da-8547-0e81a35f9246 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:48.606898 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29952499-0080-40da-8547-0e81a35f9246 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:48.607384 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29952499-0080-40da-8547-0e81a35f9246 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:48.608006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29952499-0080-40da-8547-0e81a35f9246 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:48.608547 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29952499-0080-40da-8547-0e81a35f9246 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:48.608992 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29952499-0080-40da-8547-0e81a35f9246 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:48.609411 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29952499-0080-40da-8547-0e81a35f9246 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:48.629517 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:48.750623 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-29952499-0080-40da-8547-0e81a35f9246 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:48.759853 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-29952499-0080-40da-8547-0e81a35f9246 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.164811 Aug 30 01:21:48.760469 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 271/538] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:48 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:49.228540 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-62398177-e788-458d-b303-2542186cb1c2 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:49.229163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-62398177-e788-458d-b303-2542186cb1c2 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:49.235662 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62398177-e788-458d-b303-2542186cb1c2 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:49.236178 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62398177-e788-458d-b303-2542186cb1c2 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:49.237068 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62398177-e788-458d-b303-2542186cb1c2 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:49.237641 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62398177-e788-458d-b303-2542186cb1c2 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:49.243431 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62398177-e788-458d-b303-2542186cb1c2 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:49.243876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62398177-e788-458d-b303-2542186cb1c2 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:49.401808 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-62398177-e788-458d-b303-2542186cb1c2 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:49.410945 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-62398177-e788-458d-b303-2542186cb1c2 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1757 microversion: 2.1 time: 0.186282 Aug 30 01:21:49.411520 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 268/539] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:49 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:49.782291 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f0429745-497a-49ec-8604-9b57a7abdb31 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:49.782902 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f0429745-497a-49ec-8604-9b57a7abdb31 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:49.790179 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f0429745-497a-49ec-8604-9b57a7abdb31 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:49.790998 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f0429745-497a-49ec-8604-9b57a7abdb31 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:49.791618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f0429745-497a-49ec-8604-9b57a7abdb31 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:49.792525 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f0429745-497a-49ec-8604-9b57a7abdb31 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:49.793138 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f0429745-497a-49ec-8604-9b57a7abdb31 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:49.793724 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f0429745-497a-49ec-8604-9b57a7abdb31 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:49.929777 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f0429745-497a-49ec-8604-9b57a7abdb31 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:49.937379 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f0429745-497a-49ec-8604-9b57a7abdb31 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1522 microversion: 2.1 time: 0.159135 Aug 30 01:21:49.937934 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 272/540] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:49 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:50.432325 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-edfeefdd-2538-4d31-816e-03afca2516bc tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:50.432954 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-edfeefdd-2538-4d31-816e-03afca2516bc tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:50.439493 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-edfeefdd-2538-4d31-816e-03afca2516bc tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:50.439976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-edfeefdd-2538-4d31-816e-03afca2516bc tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:50.440511 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-edfeefdd-2538-4d31-816e-03afca2516bc tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:50.441352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-edfeefdd-2538-4d31-816e-03afca2516bc tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:50.441796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-edfeefdd-2538-4d31-816e-03afca2516bc tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:50.442221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-edfeefdd-2538-4d31-816e-03afca2516bc tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:50.656298 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-edfeefdd-2538-4d31-816e-03afca2516bc tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:50.669057 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-edfeefdd-2538-4d31-816e-03afca2516bc tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1760 microversion: 2.1 time: 0.239968 Aug 30 01:21:50.670026 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 269/541] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:50 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1760 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:50.765509 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-1e07a9da-5120-41fc-97e9-c4f995ef9a68 req-ec8559c1-1a37-49d7-8805-cbd1b374fd0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26186b86-98dd-4907-8665-3358fa62eb1e", "name": "network-vif-deleted", "tag": "732b6f50-130f-420b-8b3a-711de6b71f4a"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:50.775836 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1e07a9da-5120-41fc-97e9-c4f995ef9a68 req-ec8559c1-1a37-49d7-8805-cbd1b374fd0f service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:50.776356 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1e07a9da-5120-41fc-97e9-c4f995ef9a68 req-ec8559c1-1a37-49d7-8805-cbd1b374fd0f service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:50.776777 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1e07a9da-5120-41fc-97e9-c4f995ef9a68 req-ec8559c1-1a37-49d7-8805-cbd1b374fd0f service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:50.790659 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-1e07a9da-5120-41fc-97e9-c4f995ef9a68 req-ec8559c1-1a37-49d7-8805-cbd1b374fd0f service nova] Creating event network-vif-deleted:732b6f50-130f-420b-8b3a-711de6b71f4a for instance 26186b86-98dd-4907-8665-3358fa62eb1e on hv-cinder-81514 Aug 30 01:21:50.795469 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-1e07a9da-5120-41fc-97e9-c4f995ef9a68 req-ec8559c1-1a37-49d7-8805-cbd1b374fd0f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033704 Aug 30 01:21:50.796110 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 273/542] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:50.959252 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:50.959951 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:50.966073 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:50.966720 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:50.967242 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:50.967893 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:50.968458 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:50.968947 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:51.017167 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:51.017646 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:51.018082 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:51.018553 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lazy-loading 'fault' on Instance uuid 26186b86-98dd-4907-8665-3358fa62eb1e {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:21:51.064890 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5a0cf37e3b4d3084a178f83642c144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf47975f465467498be24ebe2c81ad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:51.075041 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b421bcd4-6652-418f-a869-1bcc6d560d65 tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 200 len: 1312 microversion: 2.1 time: 0.119832 Aug 30 01:21:51.075631 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 270/543] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:50 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:52.098851 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a242ff63-2703-48c8-aff4-15f5628e84ec tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:52.099461 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a242ff63-2703-48c8-aff4-15f5628e84ec tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] [instance: 26186b86-98dd-4907-8665-3358fa62eb1e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:52.105557 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a242ff63-2703-48c8-aff4-15f5628e84ec tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:52.106036 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a242ff63-2703-48c8-aff4-15f5628e84ec tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:52.106471 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a242ff63-2703-48c8-aff4-15f5628e84ec tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:52.107155 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a242ff63-2703-48c8-aff4-15f5628e84ec tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:52.107605 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a242ff63-2703-48c8-aff4-15f5628e84ec tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:52.108053 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a242ff63-2703-48c8-aff4-15f5628e84ec tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:52.121952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-a242ff63-2703-48c8-aff4-15f5628e84ec tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] HTTP exception thrown: Instance 26186b86-98dd-4907-8665-3358fa62eb1e could not be found. Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a242ff63-2703-48c8-aff4-15f5628e84ec tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Request method failure captured: Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e HTTP/1.1 Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWTyu2mYlr5SZBPqmuxeReqX8oUXqakHxF2IKof-fnI3tzgBe6Mk-AUTjC6A0JXOa4T6LtGD53koWf8oxieYjCOwBXRn6eJa2ckFuh7HaVg-Gba7cj6y-mZqMkJD3n-WhL5eNJRIXpizs-TyaFCR-XXy3d0GgG2JzExm_2cHDwfdcWE Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: adf47975f465467498be24ebe2c81ad7 Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:21:52.123544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:21:52.125173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/adf47975f465467498be24ebe2c81ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_adf47975f465467498be24ebe2c81ad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:21:52.125173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:21:52.125173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: adf47975f465467498be24ebe2c81ad7 Aug 30 01:21:52.125173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1122969509 Aug 30 01:21:52.125173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-ServerRescueNegativeTestJSON-1122969509-project Aug 30 01:21:52.125173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:21:52.125173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:21:52.125173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 6d5a0cf37e3b4d3084a178f83642c144 Aug 30 01:21:52.125173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1122969509-project Aug 30 01:21:52.125173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:21:52.125173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 26186b86-98dd-4907-8665-3358fa62eb1e could not be found. Aug 30 01:21:52.125173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '26186b86-98dd-4907-8665-3358fa62eb1e'} Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26186b86-98dd-4907-8665-3358fa62eb1e could not be found. Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:21:52.126034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26186b86-98dd-4907-8665-3358fa62eb1e could not be found. Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26186b86-98dd-4907-8665-3358fa62eb1e could not be found. Aug 30 01:21:52.127534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:21:52.128840 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a242ff63-2703-48c8-aff4-15f5628e84ec tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] Returning 404 to user: Instance 26186b86-98dd-4907-8665-3358fa62eb1e could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:21:52.128840 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a242ff63-2703-48c8-aff4-15f5628e84ec tempest-ServerRescueNegativeTestJSON-1122969509 tempest-ServerRescueNegativeTestJSON-1122969509-project] 10.222.0.44 "GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e" status: 404 len: 111 microversion: 2.1 time: 0.031951 Aug 30 01:21:52.128840 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 274/544] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:52 2022] GET /compute/v2.1/servers/26186b86-98dd-4907-8665-3358fa62eb1e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:01.018666 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:01.070385 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:01.140629 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c6e97a35-5b54-4704-ab5b-abc17c6101f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Action: 'create', calling method: .version_select at 0x7ff48b10af70>, body: {"keypair": {"name": "tempest-keypair-208070486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSRatt+baXQ8Oxsb65tkqTOqP+jz1AakoM/B6RK2QuuhGuvmq6d+8YYk29tuMWC2Ie5EcuXr6U4fP48GzM3H2kObUt42IC1dVfE+BM4O2Om7XMNQDvYtRznJBqLbZUlAw=="}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:01.156658 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-c6e97a35-5b54-4704-ab5b-abc17c6101f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Getting quotas for project 5d08b735ca4249309f4ecd40cbacd537. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:22:01.161053 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-c6e97a35-5b54-4704-ab5b-abc17c6101f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Getting quotas for user 22bf08f4cdb24731bf00c7962bf81c40 and project 5d08b735ca4249309f4ecd40cbacd537. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:22:01.186142 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c6e97a35-5b54-4704-ab5b-abc17c6101f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.173041 Aug 30 01:22:01.186751 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 271/545] 10.222.0.44 () {62 vars in 1200 bytes} [Tue Aug 30 01:22:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 01:22:02.701824 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1133990159", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7931701-abc1-4317-a5b8-4bc0c704b8a3"}], "security_groups": [{"name": "tempest-securitygroup--330024414"}], "key_name": "tempest-keypair-208070486", "user_data": "}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:02.712176 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:02.712911 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=12 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:02.817565 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] validate_networks() for [('d7931701-abc1-4317-a5b8-4bc0c704b8a3', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:22:03.254173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:22:03.254597 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:22:03.255072 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:22:03.255484 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:22:03.255899 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:22:03.264838 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:03.265327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:03.265761 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:03.266509 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:03.267501 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:03.268126 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:03.285948 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Getting quotas for project 5d08b735ca4249309f4ecd40cbacd537. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:22:03.290583 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Getting quotas for user 22bf08f4cdb24731bf00c7962bf81c40 and project 5d08b735ca4249309f4ecd40cbacd537. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:22:03.302939 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:22:03.305306 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:22:03.353428 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-79146f99-abc3-49db-b9b5-45fe1279751b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.656040 Aug 30 01:22:03.354082 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 275/546] 10.222.0.44 () {62 vars in 1188 bytes} [Tue Aug 30 01:22:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 01:22:03.365066 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-73c8c0c7-6d38-4982-a9ac-859cd44012ef tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:03.365670 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-73c8c0c7-6d38-4982-a9ac-859cd44012ef tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:03.444057 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-73c8c0c7-6d38-4982-a9ac-859cd44012ef tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:03.454565 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-73c8c0c7-6d38-4982-a9ac-859cd44012ef tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:03.456236 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-73c8c0c7-6d38-4982-a9ac-859cd44012ef tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:03.457357 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-73c8c0c7-6d38-4982-a9ac-859cd44012ef tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1281 microversion: 2.20 time: 0.096238 Aug 30 01:22:03.458264 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 272/547] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:03 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:22:04.479372 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-62b71b46-b054-4b26-ab8e-e14a8aec5cc4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:04.480035 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-62b71b46-b054-4b26-ab8e-e14a8aec5cc4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:04.488769 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62b71b46-b054-4b26-ab8e-e14a8aec5cc4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:04.489353 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62b71b46-b054-4b26-ab8e-e14a8aec5cc4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:04.490034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62b71b46-b054-4b26-ab8e-e14a8aec5cc4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:04.490912 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62b71b46-b054-4b26-ab8e-e14a8aec5cc4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:04.491533 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62b71b46-b054-4b26-ab8e-e14a8aec5cc4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:04.491955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62b71b46-b054-4b26-ab8e-e14a8aec5cc4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:04.572707 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-62b71b46-b054-4b26-ab8e-e14a8aec5cc4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:04.584104 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-62b71b46-b054-4b26-ab8e-e14a8aec5cc4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:04.587635 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-62b71b46-b054-4b26-ab8e-e14a8aec5cc4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:04.589197 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-62b71b46-b054-4b26-ab8e-e14a8aec5cc4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1333 microversion: 2.20 time: 0.113651 Aug 30 01:22:04.589919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 276/548] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:04 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1333 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:22:05.617741 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e98d4994-c9fb-479f-bf1c-d250ff17d091 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:05.618369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e98d4994-c9fb-479f-bf1c-d250ff17d091 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:05.626752 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e98d4994-c9fb-479f-bf1c-d250ff17d091 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:05.627331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e98d4994-c9fb-479f-bf1c-d250ff17d091 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:05.627871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e98d4994-c9fb-479f-bf1c-d250ff17d091 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:05.628881 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e98d4994-c9fb-479f-bf1c-d250ff17d091 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:05.629346 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e98d4994-c9fb-479f-bf1c-d250ff17d091 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:05.629801 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e98d4994-c9fb-479f-bf1c-d250ff17d091 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:05.840362 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e98d4994-c9fb-479f-bf1c-d250ff17d091 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:05.849447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e98d4994-c9fb-479f-bf1c-d250ff17d091 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:05.850892 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e98d4994-c9fb-479f-bf1c-d250ff17d091 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:05.852401 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e98d4994-c9fb-479f-bf1c-d250ff17d091 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1406 microversion: 2.20 time: 0.238436 Aug 30 01:22:05.853039 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 273/549] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:05 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:22:06.371579 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-3b9e9df5-f3ef-48a9-b91c-91b34629549a req-3bbcad18-6f9f-4934-9bd9-5335f7c0d687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa5b2d0-a841-4330-998e-ecb58b4ef9f3", "tag": "4ccc2f03-e4d5-41df-ae6e-d6c35f2a9ef3"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:06.381658 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-3b9e9df5-f3ef-48a9-b91c-91b34629549a req-3bbcad18-6f9f-4934-9bd9-5335f7c0d687 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:06.382226 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-3b9e9df5-f3ef-48a9-b91c-91b34629549a req-3bbcad18-6f9f-4934-9bd9-5335f7c0d687 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:06.382722 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-3b9e9df5-f3ef-48a9-b91c-91b34629549a req-3bbcad18-6f9f-4934-9bd9-5335f7c0d687 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:06.394213 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-3b9e9df5-f3ef-48a9-b91c-91b34629549a req-3bbcad18-6f9f-4934-9bd9-5335f7c0d687 service nova] Creating event network-changed:4ccc2f03-e4d5-41df-ae6e-d6c35f2a9ef3 for instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 on hv-cinder-81514 Aug 30 01:22:06.399059 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-3b9e9df5-f3ef-48a9-b91c-91b34629549a req-3bbcad18-6f9f-4934-9bd9-5335f7c0d687 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104802 Aug 30 01:22:06.399781 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 277/550] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:06.874950 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-32754acc-e125-4518-a235-f200ecce2138 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:06.875590 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-32754acc-e125-4518-a235-f200ecce2138 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:06.882679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-32754acc-e125-4518-a235-f200ecce2138 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:06.883161 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-32754acc-e125-4518-a235-f200ecce2138 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:06.883597 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-32754acc-e125-4518-a235-f200ecce2138 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:06.884324 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-32754acc-e125-4518-a235-f200ecce2138 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:06.884784 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-32754acc-e125-4518-a235-f200ecce2138 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:06.885207 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-32754acc-e125-4518-a235-f200ecce2138 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:07.016160 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-32754acc-e125-4518-a235-f200ecce2138 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:07.025317 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-32754acc-e125-4518-a235-f200ecce2138 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:07.026761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-32754acc-e125-4518-a235-f200ecce2138 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:07.027900 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-32754acc-e125-4518-a235-f200ecce2138 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1406 microversion: 2.20 time: 0.156888 Aug 30 01:22:07.028494 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 274/551] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:06 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:22:08.052721 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2df25fe3-fb7c-4476-b63e-9290634b9e82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:08.053395 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2df25fe3-fb7c-4476-b63e-9290634b9e82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:08.059834 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2df25fe3-fb7c-4476-b63e-9290634b9e82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:08.060350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2df25fe3-fb7c-4476-b63e-9290634b9e82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:08.060790 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2df25fe3-fb7c-4476-b63e-9290634b9e82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:08.061487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2df25fe3-fb7c-4476-b63e-9290634b9e82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:08.061939 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2df25fe3-fb7c-4476-b63e-9290634b9e82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:08.062366 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2df25fe3-fb7c-4476-b63e-9290634b9e82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:08.207840 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2df25fe3-fb7c-4476-b63e-9290634b9e82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:08.218808 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2df25fe3-fb7c-4476-b63e-9290634b9e82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:08.220373 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2df25fe3-fb7c-4476-b63e-9290634b9e82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:08.221498 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2df25fe3-fb7c-4476-b63e-9290634b9e82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1406 microversion: 2.20 time: 0.174495 Aug 30 01:22:08.236233 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 278/552] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:08 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:22:09.246317 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d6a1dabf-27b9-4cec-892e-6ee2450035af tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:09.246918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d6a1dabf-27b9-4cec-892e-6ee2450035af tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:09.254606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6a1dabf-27b9-4cec-892e-6ee2450035af tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:09.255086 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6a1dabf-27b9-4cec-892e-6ee2450035af tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:09.255537 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6a1dabf-27b9-4cec-892e-6ee2450035af tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:09.256227 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6a1dabf-27b9-4cec-892e-6ee2450035af tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:09.256679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6a1dabf-27b9-4cec-892e-6ee2450035af tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:09.257099 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6a1dabf-27b9-4cec-892e-6ee2450035af tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:09.387406 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d6a1dabf-27b9-4cec-892e-6ee2450035af tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:09.396627 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d6a1dabf-27b9-4cec-892e-6ee2450035af tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:09.398056 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d6a1dabf-27b9-4cec-892e-6ee2450035af tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:09.399200 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d6a1dabf-27b9-4cec-892e-6ee2450035af tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1406 microversion: 2.20 time: 0.157074 Aug 30 01:22:09.399758 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 275/553] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:09 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:22:10.422395 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ef1db536-60ad-4b28-80cc-ceadfbb660b8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:10.423181 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ef1db536-60ad-4b28-80cc-ceadfbb660b8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:10.429415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef1db536-60ad-4b28-80cc-ceadfbb660b8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:10.429899 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef1db536-60ad-4b28-80cc-ceadfbb660b8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:10.430364 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef1db536-60ad-4b28-80cc-ceadfbb660b8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:10.431053 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef1db536-60ad-4b28-80cc-ceadfbb660b8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:10.431506 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef1db536-60ad-4b28-80cc-ceadfbb660b8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:10.431929 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef1db536-60ad-4b28-80cc-ceadfbb660b8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:10.560071 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ef1db536-60ad-4b28-80cc-ceadfbb660b8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:10.568400 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ef1db536-60ad-4b28-80cc-ceadfbb660b8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:10.570036 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ef1db536-60ad-4b28-80cc-ceadfbb660b8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:10.571649 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ef1db536-60ad-4b28-80cc-ceadfbb660b8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1406 microversion: 2.20 time: 0.152885 Aug 30 01:22:10.571883 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 279/554] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:10 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:22:11.595288 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-67f92a4a-8ebc-43e8-84b1-c11e3d45eecb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:11.595903 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-67f92a4a-8ebc-43e8-84b1-c11e3d45eecb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:11.602452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67f92a4a-8ebc-43e8-84b1-c11e3d45eecb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:11.602929 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67f92a4a-8ebc-43e8-84b1-c11e3d45eecb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:11.603363 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67f92a4a-8ebc-43e8-84b1-c11e3d45eecb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:11.604071 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67f92a4a-8ebc-43e8-84b1-c11e3d45eecb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:11.604520 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67f92a4a-8ebc-43e8-84b1-c11e3d45eecb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:11.604943 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67f92a4a-8ebc-43e8-84b1-c11e3d45eecb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:11.741527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-67f92a4a-8ebc-43e8-84b1-c11e3d45eecb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:11.749878 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-67f92a4a-8ebc-43e8-84b1-c11e3d45eecb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:11.751484 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-67f92a4a-8ebc-43e8-84b1-c11e3d45eecb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:11.752627 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-67f92a4a-8ebc-43e8-84b1-c11e3d45eecb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1406 microversion: 2.20 time: 0.162180 Aug 30 01:22:11.753186 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 276/555] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:11 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:22:12.775390 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-60c52a88-36ae-4b17-909b-0bf74e710ce6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:12.776146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-60c52a88-36ae-4b17-909b-0bf74e710ce6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:12.783193 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60c52a88-36ae-4b17-909b-0bf74e710ce6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:12.783756 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60c52a88-36ae-4b17-909b-0bf74e710ce6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:12.784225 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60c52a88-36ae-4b17-909b-0bf74e710ce6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:12.784920 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60c52a88-36ae-4b17-909b-0bf74e710ce6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:12.785369 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60c52a88-36ae-4b17-909b-0bf74e710ce6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:12.785794 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60c52a88-36ae-4b17-909b-0bf74e710ce6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:12.925952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-60c52a88-36ae-4b17-909b-0bf74e710ce6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:12.934276 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-60c52a88-36ae-4b17-909b-0bf74e710ce6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:12.935926 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-60c52a88-36ae-4b17-909b-0bf74e710ce6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:12.937079 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-60c52a88-36ae-4b17-909b-0bf74e710ce6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1406 microversion: 2.20 time: 0.165581 Aug 30 01:22:12.937628 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 280/556] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:12 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:22:12.940836 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-6ff4632a-ed32-4224-a789-aa83b4c25193 req-9cce0901-13ee-414b-a6b7-592f55dcc509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa5b2d0-a841-4330-998e-ecb58b4ef9f3", "name": "network-vif-plugged", "status": "completed", "tag": "4ccc2f03-e4d5-41df-ae6e-d6c35f2a9ef3"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:12.950606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-6ff4632a-ed32-4224-a789-aa83b4c25193 req-9cce0901-13ee-414b-a6b7-592f55dcc509 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:12.951254 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-6ff4632a-ed32-4224-a789-aa83b4c25193 req-9cce0901-13ee-414b-a6b7-592f55dcc509 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:12.951680 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-6ff4632a-ed32-4224-a789-aa83b4c25193 req-9cce0901-13ee-414b-a6b7-592f55dcc509 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:12.962976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-6ff4632a-ed32-4224-a789-aa83b4c25193 req-9cce0901-13ee-414b-a6b7-592f55dcc509 service nova] Creating event network-vif-plugged:4ccc2f03-e4d5-41df-ae6e-d6c35f2a9ef3 for instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 on hv-cinder-81514 Aug 30 01:22:12.967840 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-6ff4632a-ed32-4224-a789-aa83b4c25193 req-9cce0901-13ee-414b-a6b7-592f55dcc509 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106557 Aug 30 01:22:12.968488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 277/557] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:22:13.704957 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1cba31ca-e7c0-4614-82a6-3a28daf3b7e7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:13.705453 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1cba31ca-e7c0-4614-82a6-3a28daf3b7e7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:13.707435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:13.708139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:13.714242 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1cba31ca-e7c0-4614-82a6-3a28daf3b7e7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:13.714727 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1cba31ca-e7c0-4614-82a6-3a28daf3b7e7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:13.715157 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1cba31ca-e7c0-4614-82a6-3a28daf3b7e7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:13.715848 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1cba31ca-e7c0-4614-82a6-3a28daf3b7e7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:13.716400 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1cba31ca-e7c0-4614-82a6-3a28daf3b7e7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:13.716821 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1cba31ca-e7c0-4614-82a6-3a28daf3b7e7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:13.742325 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1cba31ca-e7c0-4614-82a6-3a28daf3b7e7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/ips" status: 200 len: 146 microversion: 2.1 time: 0.042007 Aug 30 01:22:13.742863 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 281/558] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Aug 30 01:22:13 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:13.961804 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:13.967950 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3d68ea67-3c5b-42d1-96f0-a300771acf78 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:13.968776 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3d68ea67-3c5b-42d1-96f0-a300771acf78 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:13.977595 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d68ea67-3c5b-42d1-96f0-a300771acf78 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:13.978133 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d68ea67-3c5b-42d1-96f0-a300771acf78 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:13.978578 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d68ea67-3c5b-42d1-96f0-a300771acf78 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:13.980363 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d68ea67-3c5b-42d1-96f0-a300771acf78 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:13.980835 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d68ea67-3c5b-42d1-96f0-a300771acf78 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:13.981267 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d68ea67-3c5b-42d1-96f0-a300771acf78 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:14.126299 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3d68ea67-3c5b-42d1-96f0-a300771acf78 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:14.134473 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3d68ea67-3c5b-42d1-96f0-a300771acf78 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:14.135931 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3d68ea67-3c5b-42d1-96f0-a300771acf78 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:14.137066 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3d68ea67-3c5b-42d1-96f0-a300771acf78 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1406 microversion: 2.20 time: 0.176254 Aug 30 01:22:14.137623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 278/559] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:13 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:22:15.086032 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-556e5816-f757-4380-ba5f-525391178952 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f1c085f-cf99-4bfc-89de-19409bd4b4f5"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:15.088492 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-556e5816-f757-4380-ba5f-525391178952 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:15.096584 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-556e5816-f757-4380-ba5f-525391178952 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:15.097180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-556e5816-f757-4380-ba5f-525391178952 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:15.097624 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-556e5816-f757-4380-ba5f-525391178952 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:15.098329 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-556e5816-f757-4380-ba5f-525391178952 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:15.098896 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-556e5816-f757-4380-ba5f-525391178952 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:15.099242 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-556e5816-f757-4380-ba5f-525391178952 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:15.161013 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7ce1065e-0bed-47ed-92ff-59230ad46dc8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:15.161863 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7ce1065e-0bed-47ed-92ff-59230ad46dc8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:15.168494 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ce1065e-0bed-47ed-92ff-59230ad46dc8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:15.168988 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ce1065e-0bed-47ed-92ff-59230ad46dc8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:15.169421 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ce1065e-0bed-47ed-92ff-59230ad46dc8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:15.170129 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ce1065e-0bed-47ed-92ff-59230ad46dc8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:15.170579 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ce1065e-0bed-47ed-92ff-59230ad46dc8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:15.171001 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ce1065e-0bed-47ed-92ff-59230ad46dc8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:15.307554 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7ce1065e-0bed-47ed-92ff-59230ad46dc8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:15.316524 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7ce1065e-0bed-47ed-92ff-59230ad46dc8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:15.317966 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7ce1065e-0bed-47ed-92ff-59230ad46dc8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:15.319154 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7ce1065e-0bed-47ed-92ff-59230ad46dc8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1599 microversion: 2.20 time: 0.162449 Aug 30 01:22:15.319703 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 279/560] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:15 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:22:15.342428 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3f346ca0-2f82-424b-bba1-fb6d587c36cc tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:15.342923 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3f346ca0-2f82-424b-bba1-fb6d587c36cc tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:15.349605 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3f346ca0-2f82-424b-bba1-fb6d587c36cc tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:15.350078 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3f346ca0-2f82-424b-bba1-fb6d587c36cc tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:15.350511 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3f346ca0-2f82-424b-bba1-fb6d587c36cc tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:15.351231 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3f346ca0-2f82-424b-bba1-fb6d587c36cc tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:15.351682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3f346ca0-2f82-424b-bba1-fb6d587c36cc tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:15.352138 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3f346ca0-2f82-424b-bba1-fb6d587c36cc tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:15.398415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-556e5816-f757-4380-ba5f-525391178952 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "POST /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316184 Aug 30 01:22:15.399051 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 282/561] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:22:15 2022] POST /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:15.441988 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3f346ca0-2f82-424b-bba1-fb6d587c36cc tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103182 Aug 30 01:22:15.443139 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 280/562] 10.222.0.44 () {60 vars in 1316 bytes} [Tue Aug 30 01:22:15 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:22:16.413994 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-76b103cb-2042-4eb3-bca3-7ae5edeb32a0 req-f07964d4-19f6-41a2-82eb-6b8c47a4eab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa5b2d0-a841-4330-998e-ecb58b4ef9f3", "tag": "4ccc2f03-e4d5-41df-ae6e-d6c35f2a9ef3"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:16.424886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-76b103cb-2042-4eb3-bca3-7ae5edeb32a0 req-f07964d4-19f6-41a2-82eb-6b8c47a4eab9 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:16.425269 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-76b103cb-2042-4eb3-bca3-7ae5edeb32a0 req-f07964d4-19f6-41a2-82eb-6b8c47a4eab9 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:16.425697 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-76b103cb-2042-4eb3-bca3-7ae5edeb32a0 req-f07964d4-19f6-41a2-82eb-6b8c47a4eab9 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:16.437656 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-76b103cb-2042-4eb3-bca3-7ae5edeb32a0 req-f07964d4-19f6-41a2-82eb-6b8c47a4eab9 service nova] Creating event network-changed:4ccc2f03-e4d5-41df-ae6e-d6c35f2a9ef3 for instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 on hv-cinder-81514 Aug 30 01:22:16.443407 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-76b103cb-2042-4eb3-bca3-7ae5edeb32a0 req-f07964d4-19f6-41a2-82eb-6b8c47a4eab9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033280 Aug 30 01:22:16.444023 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 283/563] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:19.217066 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a69725d3-ac78-4e3a-b2c9-3d49603ff7bd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:19.217625 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a69725d3-ac78-4e3a-b2c9-3d49603ff7bd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:19.223866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a69725d3-ac78-4e3a-b2c9-3d49603ff7bd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:19.224382 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a69725d3-ac78-4e3a-b2c9-3d49603ff7bd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:19.224813 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a69725d3-ac78-4e3a-b2c9-3d49603ff7bd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:19.225495 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a69725d3-ac78-4e3a-b2c9-3d49603ff7bd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:19.225944 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a69725d3-ac78-4e3a-b2c9-3d49603ff7bd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:19.226368 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a69725d3-ac78-4e3a-b2c9-3d49603ff7bd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:19.249798 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-a69725d3-ac78-4e3a-b2c9-3d49603ff7bd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lazy-loading 'flavor' on Instance uuid 68833d42-7eed-4b4c-b315-842b9c015dfd {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:22:19.335297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a69725d3-ac78-4e3a-b2c9-3d49603ff7bd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "POST /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd/action" status: 202 len: 0 microversion: 2.1 time: 0.122445 Aug 30 01:22:19.335917 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 281/564] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:22:19 2022] POST /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:22:19.345934 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bfde3479-38be-46be-9aaf-a0640d472338 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:19.346474 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bfde3479-38be-46be-9aaf-a0640d472338 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:19.354106 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfde3479-38be-46be-9aaf-a0640d472338 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:19.354860 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfde3479-38be-46be-9aaf-a0640d472338 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:19.355348 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfde3479-38be-46be-9aaf-a0640d472338 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:19.356981 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfde3479-38be-46be-9aaf-a0640d472338 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:19.357485 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfde3479-38be-46be-9aaf-a0640d472338 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:19.358265 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfde3479-38be-46be-9aaf-a0640d472338 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:19.495720 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bfde3479-38be-46be-9aaf-a0640d472338 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:19.504161 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bfde3479-38be-46be-9aaf-a0640d472338 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.163575 Aug 30 01:22:19.504734 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 284/565] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:19 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:20.526930 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-61505f13-1ce4-4280-b91c-bc4939c4e077 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:20.527574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-61505f13-1ce4-4280-b91c-bc4939c4e077 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:20.534139 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-61505f13-1ce4-4280-b91c-bc4939c4e077 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:20.534620 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-61505f13-1ce4-4280-b91c-bc4939c4e077 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:20.535051 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-61505f13-1ce4-4280-b91c-bc4939c4e077 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:20.535793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-61505f13-1ce4-4280-b91c-bc4939c4e077 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:20.536273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-61505f13-1ce4-4280-b91c-bc4939c4e077 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:20.536693 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-61505f13-1ce4-4280-b91c-bc4939c4e077 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:20.672821 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-61505f13-1ce4-4280-b91c-bc4939c4e077 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:20.682072 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-61505f13-1ce4-4280-b91c-bc4939c4e077 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.159516 Aug 30 01:22:20.683070 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 282/566] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:20 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:21.705385 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-287a1264-6b2e-44fa-b2d0-292accf83ff6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:21.705975 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-287a1264-6b2e-44fa-b2d0-292accf83ff6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:21.712512 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-287a1264-6b2e-44fa-b2d0-292accf83ff6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:21.713003 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-287a1264-6b2e-44fa-b2d0-292accf83ff6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:21.713441 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-287a1264-6b2e-44fa-b2d0-292accf83ff6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:21.714171 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-287a1264-6b2e-44fa-b2d0-292accf83ff6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:21.714626 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-287a1264-6b2e-44fa-b2d0-292accf83ff6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:21.715053 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-287a1264-6b2e-44fa-b2d0-292accf83ff6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:21.862670 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-287a1264-6b2e-44fa-b2d0-292accf83ff6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:21.871181 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-287a1264-6b2e-44fa-b2d0-292accf83ff6 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.170099 Aug 30 01:22:21.871785 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 285/567] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:21 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:22.892793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f4764394-7549-482b-8a0f-16b09ae18954 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:22.893436 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f4764394-7549-482b-8a0f-16b09ae18954 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:22.899478 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4764394-7549-482b-8a0f-16b09ae18954 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:22.899965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4764394-7549-482b-8a0f-16b09ae18954 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:22.900425 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4764394-7549-482b-8a0f-16b09ae18954 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:22.901331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4764394-7549-482b-8a0f-16b09ae18954 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:22.901781 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4764394-7549-482b-8a0f-16b09ae18954 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:22.902208 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4764394-7549-482b-8a0f-16b09ae18954 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:22.949605 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e3ed030b-157d-4b23-b4d7-ace989c422ff tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:22.951846 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e3ed030b-157d-4b23-b4d7-ace989c422ff tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:22.958609 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3ed030b-157d-4b23-b4d7-ace989c422ff tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:22.959090 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3ed030b-157d-4b23-b4d7-ace989c422ff tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:22.959527 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3ed030b-157d-4b23-b4d7-ace989c422ff tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:22.960255 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3ed030b-157d-4b23-b4d7-ace989c422ff tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:22.960704 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3ed030b-157d-4b23-b4d7-ace989c422ff tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:22.961134 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3ed030b-157d-4b23-b4d7-ace989c422ff tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:22.991881 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e3ed030b-157d-4b23-b4d7-ace989c422ff tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046393 Aug 30 01:22:22.992590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 286/568] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:22:22 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:23.003377 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3962c394-c0f0-4783-ae9d-340a0b38e9fe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:23.003869 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3962c394-c0f0-4783-ae9d-340a0b38e9fe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:23.009752 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3962c394-c0f0-4783-ae9d-340a0b38e9fe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:23.010239 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3962c394-c0f0-4783-ae9d-340a0b38e9fe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:23.010682 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3962c394-c0f0-4783-ae9d-340a0b38e9fe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:23.011375 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3962c394-c0f0-4783-ae9d-340a0b38e9fe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:23.011832 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3962c394-c0f0-4783-ae9d-340a0b38e9fe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:23.012288 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3962c394-c0f0-4783-ae9d-340a0b38e9fe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:23.040966 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f4764394-7549-482b-8a0f-16b09ae18954 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:23.042740 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3962c394-c0f0-4783-ae9d-340a0b38e9fe tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments/3f1c085f-cf99-4bfc-89de-19409bd4b4f5" status: 200 len: 194 microversion: 2.1 time: 0.043316 Aug 30 01:22:23.043338 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 287/569] 10.222.0.44 () {58 vars in 1413 bytes} [Tue Aug 30 01:22:22 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments/3f1c085f-cf99-4bfc-89de-19409bd4b4f5 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:22:23.049877 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f4764394-7549-482b-8a0f-16b09ae18954 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.160849 Aug 30 01:22:23.050458 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 283/570] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:22 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:24.070507 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-678ae683-1d28-413f-94c9-f699d97a6700 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:24.071029 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-678ae683-1d28-413f-94c9-f699d97a6700 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:24.078674 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-678ae683-1d28-413f-94c9-f699d97a6700 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:24.079158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-678ae683-1d28-413f-94c9-f699d97a6700 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:24.079592 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-678ae683-1d28-413f-94c9-f699d97a6700 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:24.080311 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-678ae683-1d28-413f-94c9-f699d97a6700 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:24.080766 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-678ae683-1d28-413f-94c9-f699d97a6700 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:24.081180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-678ae683-1d28-413f-94c9-f699d97a6700 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:24.213391 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-678ae683-1d28-413f-94c9-f699d97a6700 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:24.221662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-678ae683-1d28-413f-94c9-f699d97a6700 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.155094 Aug 30 01:22:24.222225 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 288/571] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:24 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:24.370936 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2884f20d-7de2-4ac2-a3bf-00b2097b975a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21622bd8-7b94-4155-9731-a4f430e56ec9"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:24.373330 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2884f20d-7de2-4ac2-a3bf-00b2097b975a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:24.380177 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2884f20d-7de2-4ac2-a3bf-00b2097b975a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:24.380654 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2884f20d-7de2-4ac2-a3bf-00b2097b975a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:24.381079 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2884f20d-7de2-4ac2-a3bf-00b2097b975a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:24.381758 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2884f20d-7de2-4ac2-a3bf-00b2097b975a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:24.382196 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2884f20d-7de2-4ac2-a3bf-00b2097b975a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:24.382612 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2884f20d-7de2-4ac2-a3bf-00b2097b975a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:24.698224 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2884f20d-7de2-4ac2-a3bf-00b2097b975a tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "POST /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331321 Aug 30 01:22:24.699072 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 284/572] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:22:24 2022] POST /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:25.242742 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3f96774f-67e9-4660-96d0-76667abce270 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:25.243343 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3f96774f-67e9-4660-96d0-76667abce270 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:25.250089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f96774f-67e9-4660-96d0-76667abce270 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:25.251266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f96774f-67e9-4660-96d0-76667abce270 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:25.251705 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f96774f-67e9-4660-96d0-76667abce270 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:25.252430 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f96774f-67e9-4660-96d0-76667abce270 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:25.252889 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f96774f-67e9-4660-96d0-76667abce270 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:25.253318 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f96774f-67e9-4660-96d0-76667abce270 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:25.389755 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3f96774f-67e9-4660-96d0-76667abce270 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:25.397765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3f96774f-67e9-4660-96d0-76667abce270 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.158862 Aug 30 01:22:25.398443 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 289/573] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:25 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:25.850999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0833e3a3-5047-4688-a61a-13067adab870 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1159516230"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:25.851611 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0833e3a3-5047-4688-a61a-13067adab870 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:25.858317 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0833e3a3-5047-4688-a61a-13067adab870 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:25.858795 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0833e3a3-5047-4688-a61a-13067adab870 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:25.859220 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0833e3a3-5047-4688-a61a-13067adab870 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:25.860589 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0833e3a3-5047-4688-a61a-13067adab870 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:25.861039 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0833e3a3-5047-4688-a61a-13067adab870 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:25.861456 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0833e3a3-5047-4688-a61a-13067adab870 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:25.990102 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.network.security_group_api [None req-0833e3a3-5047-4688-a61a-13067adab870 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Removing security group 38813d61-0027-4417-83b0-48794231d787 from port 481cfbb3-ad8c-4d71-a2e4-067031b651cb Aug 30 01:22:26.311100 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0833e3a3-5047-4688-a61a-13067adab870 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "POST /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/action" status: 202 len: 0 microversion: 2.1 time: 0.464225 Aug 30 01:22:26.311709 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 285/574] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:22:25 2022] POST /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:22:26.320551 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-5e58da82-30bf-415e-8560-31984ca5a09e req-c814f473-ed18-4701-add6-3097cac8bbbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f03d56-24a2-4446-8eec-c95cb2050d24", "tag": "481cfbb3-ad8c-4d71-a2e4-067031b651cb"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:26.354329 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-5e58da82-30bf-415e-8560-31984ca5a09e req-c814f473-ed18-4701-add6-3097cac8bbbd service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:26.354814 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-5e58da82-30bf-415e-8560-31984ca5a09e req-c814f473-ed18-4701-add6-3097cac8bbbd service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:26.355248 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-5e58da82-30bf-415e-8560-31984ca5a09e req-c814f473-ed18-4701-add6-3097cac8bbbd service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:26.367082 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-5e58da82-30bf-415e-8560-31984ca5a09e req-c814f473-ed18-4701-add6-3097cac8bbbd service nova] Creating event network-changed:481cfbb3-ad8c-4d71-a2e4-067031b651cb for instance c0f03d56-24a2-4446-8eec-c95cb2050d24 on hv-cinder-81514 Aug 30 01:22:26.372898 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-5e58da82-30bf-415e-8560-31984ca5a09e req-c814f473-ed18-4701-add6-3097cac8bbbd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055863 Aug 30 01:22:26.374195 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 290/575] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:26.419783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-67d8a1d8-e9cf-4df1-a317-4439dfc6b019 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:26.424134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-67d8a1d8-e9cf-4df1-a317-4439dfc6b019 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:26.434693 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67d8a1d8-e9cf-4df1-a317-4439dfc6b019 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:26.435183 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67d8a1d8-e9cf-4df1-a317-4439dfc6b019 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:26.435616 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67d8a1d8-e9cf-4df1-a317-4439dfc6b019 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:26.436343 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67d8a1d8-e9cf-4df1-a317-4439dfc6b019 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:26.446349 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67d8a1d8-e9cf-4df1-a317-4439dfc6b019 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:26.446800 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67d8a1d8-e9cf-4df1-a317-4439dfc6b019 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:26.786869 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-67d8a1d8-e9cf-4df1-a317-4439dfc6b019 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:26.794946 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-67d8a1d8-e9cf-4df1-a317-4439dfc6b019 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.379047 Aug 30 01:22:26.795530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 286/576] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:26 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:27.818393 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fae5cd4b-b3bd-4b18-840e-a3716dfb2477 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:27.819094 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fae5cd4b-b3bd-4b18-840e-a3716dfb2477 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:27.825295 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fae5cd4b-b3bd-4b18-840e-a3716dfb2477 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:27.825778 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fae5cd4b-b3bd-4b18-840e-a3716dfb2477 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:27.826216 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fae5cd4b-b3bd-4b18-840e-a3716dfb2477 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:27.826912 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fae5cd4b-b3bd-4b18-840e-a3716dfb2477 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:27.827482 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fae5cd4b-b3bd-4b18-840e-a3716dfb2477 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:27.827866 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fae5cd4b-b3bd-4b18-840e-a3716dfb2477 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:27.999189 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fae5cd4b-b3bd-4b18-840e-a3716dfb2477 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:28.007877 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fae5cd4b-b3bd-4b18-840e-a3716dfb2477 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.194196 Aug 30 01:22:28.008599 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 291/577] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:27 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:28.082575 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-38ff030e-b33e-4083-8a3a-8265a14a5862 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:28.083137 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-38ff030e-b33e-4083-8a3a-8265a14a5862 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:28.089747 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-38ff030e-b33e-4083-8a3a-8265a14a5862 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:28.090222 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-38ff030e-b33e-4083-8a3a-8265a14a5862 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:28.090650 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-38ff030e-b33e-4083-8a3a-8265a14a5862 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:28.091338 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-38ff030e-b33e-4083-8a3a-8265a14a5862 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:28.091781 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-38ff030e-b33e-4083-8a3a-8265a14a5862 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:28.092236 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-38ff030e-b33e-4083-8a3a-8265a14a5862 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:28.110462 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:28.177010 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-38ff030e-b33e-4083-8a3a-8265a14a5862 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lazy-loading 'services' on Instance uuid c0f03d56-24a2-4446-8eec-c95cb2050d24 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:22:28.267319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-38ff030e-b33e-4083-8a3a-8265a14a5862 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments/1955b77a-0c60-4b21-b7b6-12bed0405a04" status: 202 len: 0 microversion: 2.1 time: 0.189042 Aug 30 01:22:28.268236 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 287/578] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Aug 30 01:22:28 2022] DELETE /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments/1955b77a-0c60-4b21-b7b6-12bed0405a04 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:22:28.276493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a312a4fb-30e0-4438-ba80-0a4760859714 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:28.278676 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a312a4fb-30e0-4438-ba80-0a4760859714 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:28.284755 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a312a4fb-30e0-4438-ba80-0a4760859714 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:28.285482 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a312a4fb-30e0-4438-ba80-0a4760859714 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:28.285924 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a312a4fb-30e0-4438-ba80-0a4760859714 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:28.286623 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a312a4fb-30e0-4438-ba80-0a4760859714 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:28.287079 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a312a4fb-30e0-4438-ba80-0a4760859714 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:28.287503 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a312a4fb-30e0-4438-ba80-0a4760859714 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:28.317954 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a312a4fb-30e0-4438-ba80-0a4760859714 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045551 Aug 30 01:22:28.318514 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 292/579] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:22:28 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:28.388594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-69626987-9db1-4f1a-bc36-0cd60b73d6a1 req-6b358a8d-4009-4829-b610-a20380dcac15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f03d56-24a2-4446-8eec-c95cb2050d24", "tag": "481cfbb3-ad8c-4d71-a2e4-067031b651cb"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:28.398409 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-69626987-9db1-4f1a-bc36-0cd60b73d6a1 req-6b358a8d-4009-4829-b610-a20380dcac15 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:28.398970 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-69626987-9db1-4f1a-bc36-0cd60b73d6a1 req-6b358a8d-4009-4829-b610-a20380dcac15 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:28.399489 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-69626987-9db1-4f1a-bc36-0cd60b73d6a1 req-6b358a8d-4009-4829-b610-a20380dcac15 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:28.412256 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-69626987-9db1-4f1a-bc36-0cd60b73d6a1 req-6b358a8d-4009-4829-b610-a20380dcac15 service nova] Creating event network-changed:481cfbb3-ad8c-4d71-a2e4-067031b651cb for instance c0f03d56-24a2-4446-8eec-c95cb2050d24 on hv-cinder-81514 Aug 30 01:22:28.417420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-69626987-9db1-4f1a-bc36-0cd60b73d6a1 req-6b358a8d-4009-4829-b610-a20380dcac15 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032907 Aug 30 01:22:28.418123 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 288/580] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:29.030383 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bfadae2b-2831-4289-89e0-0dfe5a17adf5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:29.031004 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bfadae2b-2831-4289-89e0-0dfe5a17adf5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:29.038833 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfadae2b-2831-4289-89e0-0dfe5a17adf5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:29.039332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfadae2b-2831-4289-89e0-0dfe5a17adf5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:29.039773 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfadae2b-2831-4289-89e0-0dfe5a17adf5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:29.040507 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfadae2b-2831-4289-89e0-0dfe5a17adf5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:29.040962 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfadae2b-2831-4289-89e0-0dfe5a17adf5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:29.041390 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bfadae2b-2831-4289-89e0-0dfe5a17adf5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:29.045921 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:29.198743 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bfadae2b-2831-4289-89e0-0dfe5a17adf5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:29.207289 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bfadae2b-2831-4289-89e0-0dfe5a17adf5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.181227 Aug 30 01:22:29.207952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 293/581] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:29 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:29.331720 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-59fc5fa8-a750-4d8f-9f95-d4f7f65fcba4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:29.333982 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-59fc5fa8-a750-4d8f-9f95-d4f7f65fcba4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:29.340303 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59fc5fa8-a750-4d8f-9f95-d4f7f65fcba4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:29.340783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59fc5fa8-a750-4d8f-9f95-d4f7f65fcba4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:29.341250 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59fc5fa8-a750-4d8f-9f95-d4f7f65fcba4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:29.341941 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59fc5fa8-a750-4d8f-9f95-d4f7f65fcba4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:29.342417 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59fc5fa8-a750-4d8f-9f95-d4f7f65fcba4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:29.342843 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59fc5fa8-a750-4d8f-9f95-d4f7f65fcba4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:29.372307 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-59fc5fa8-a750-4d8f-9f95-d4f7f65fcba4 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046355 Aug 30 01:22:29.372855 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 289/582] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:22:29 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:30.228757 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b2d0160c-1595-438b-9194-4af5571ec867 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:30.229363 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b2d0160c-1595-438b-9194-4af5571ec867 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:30.236451 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b2d0160c-1595-438b-9194-4af5571ec867 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:30.236927 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b2d0160c-1595-438b-9194-4af5571ec867 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:30.237360 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b2d0160c-1595-438b-9194-4af5571ec867 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:30.238079 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b2d0160c-1595-438b-9194-4af5571ec867 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:30.238532 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b2d0160c-1595-438b-9194-4af5571ec867 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:30.240373 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b2d0160c-1595-438b-9194-4af5571ec867 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:30.367859 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b2d0160c-1595-438b-9194-4af5571ec867 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:30.375956 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b2d0160c-1595-438b-9194-4af5571ec867 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.150981 Aug 30 01:22:30.376554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 294/583] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:30 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:30.385350 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ed67092b-d083-4cff-b79f-dfce48614c22 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:30.387490 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ed67092b-d083-4cff-b79f-dfce48614c22 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:30.394448 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ed67092b-d083-4cff-b79f-dfce48614c22 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:30.394928 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ed67092b-d083-4cff-b79f-dfce48614c22 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:30.395363 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ed67092b-d083-4cff-b79f-dfce48614c22 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:30.396075 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ed67092b-d083-4cff-b79f-dfce48614c22 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:30.396524 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ed67092b-d083-4cff-b79f-dfce48614c22 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:30.396945 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ed67092b-d083-4cff-b79f-dfce48614c22 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:30.426329 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ed67092b-d083-4cff-b79f-dfce48614c22 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044828 Aug 30 01:22:30.426878 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 290/584] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:22:30 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:31.397204 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-26511251-5b05-48e6-9c66-e5ad14edb424 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:31.397746 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-26511251-5b05-48e6-9c66-e5ad14edb424 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:31.404042 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26511251-5b05-48e6-9c66-e5ad14edb424 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:31.404545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26511251-5b05-48e6-9c66-e5ad14edb424 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:31.404970 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26511251-5b05-48e6-9c66-e5ad14edb424 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:31.405676 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26511251-5b05-48e6-9c66-e5ad14edb424 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:31.406267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26511251-5b05-48e6-9c66-e5ad14edb424 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:31.406692 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26511251-5b05-48e6-9c66-e5ad14edb424 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:31.439346 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2d0738eb-498c-4741-8574-536085df5b12 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:31.441572 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2d0738eb-498c-4741-8574-536085df5b12 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:31.444057 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:31.449811 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d0738eb-498c-4741-8574-536085df5b12 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:31.450303 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d0738eb-498c-4741-8574-536085df5b12 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:31.450741 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d0738eb-498c-4741-8574-536085df5b12 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:31.451445 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d0738eb-498c-4741-8574-536085df5b12 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:31.451898 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d0738eb-498c-4741-8574-536085df5b12 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:31.452350 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d0738eb-498c-4741-8574-536085df5b12 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:31.483325 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2d0738eb-498c-4741-8574-536085df5b12 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048567 Aug 30 01:22:31.484417 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 291/585] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:22:31 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:22:31.538589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-26511251-5b05-48e6-9c66-e5ad14edb424 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:31.546324 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-26511251-5b05-48e6-9c66-e5ad14edb424 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.153060 Aug 30 01:22:31.547966 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 295/586] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:31 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:32.496553 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a66df8ba-097e-447c-8de3-40b80cc6f6b8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:32.498685 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a66df8ba-097e-447c-8de3-40b80cc6f6b8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:32.505788 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a66df8ba-097e-447c-8de3-40b80cc6f6b8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:32.506269 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a66df8ba-097e-447c-8de3-40b80cc6f6b8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:32.506696 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a66df8ba-097e-447c-8de3-40b80cc6f6b8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:32.507380 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a66df8ba-097e-447c-8de3-40b80cc6f6b8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:32.507835 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a66df8ba-097e-447c-8de3-40b80cc6f6b8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:32.508279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a66df8ba-097e-447c-8de3-40b80cc6f6b8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:32.537519 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a66df8ba-097e-447c-8de3-40b80cc6f6b8 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Aug 30 01:22:32.538076 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 292/587] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:22:32 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:22:32.568842 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bc7d33f8-4ee3-4fb0-b0cb-0ab889bfe6e7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:32.569485 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bc7d33f8-4ee3-4fb0-b0cb-0ab889bfe6e7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:32.575896 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc7d33f8-4ee3-4fb0-b0cb-0ab889bfe6e7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:32.576410 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc7d33f8-4ee3-4fb0-b0cb-0ab889bfe6e7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:32.576874 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc7d33f8-4ee3-4fb0-b0cb-0ab889bfe6e7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:32.578191 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc7d33f8-4ee3-4fb0-b0cb-0ab889bfe6e7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:32.578653 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc7d33f8-4ee3-4fb0-b0cb-0ab889bfe6e7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:32.579078 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc7d33f8-4ee3-4fb0-b0cb-0ab889bfe6e7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:32.717614 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bc7d33f8-4ee3-4fb0-b0cb-0ab889bfe6e7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:32.726014 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bc7d33f8-4ee3-4fb0-b0cb-0ab889bfe6e7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.160988 Aug 30 01:22:32.726581 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 296/588] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:32 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:33.323248 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-579fd687-4edd-4742-899e-af7f65380c2e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:33.325464 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-579fd687-4edd-4742-899e-af7f65380c2e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:33.331532 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-579fd687-4edd-4742-899e-af7f65380c2e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:33.332039 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-579fd687-4edd-4742-899e-af7f65380c2e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:33.332484 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-579fd687-4edd-4742-899e-af7f65380c2e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:33.333175 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-579fd687-4edd-4742-899e-af7f65380c2e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:33.333632 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-579fd687-4edd-4742-899e-af7f65380c2e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:33.334055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-579fd687-4edd-4742-899e-af7f65380c2e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:33.365802 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-579fd687-4edd-4742-899e-af7f65380c2e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046587 Aug 30 01:22:33.366366 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 293/589] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:22:33 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:33.523475 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7779ea0e-5348-4983-a7e0-4b54b6883862 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:33.524187 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7779ea0e-5348-4983-a7e0-4b54b6883862 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:33.527879 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:33.532068 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7779ea0e-5348-4983-a7e0-4b54b6883862 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:33.532790 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7779ea0e-5348-4983-a7e0-4b54b6883862 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:33.533637 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7779ea0e-5348-4983-a7e0-4b54b6883862 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:33.534421 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7779ea0e-5348-4983-a7e0-4b54b6883862 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:33.534978 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7779ea0e-5348-4983-a7e0-4b54b6883862 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:33.535963 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7779ea0e-5348-4983-a7e0-4b54b6883862 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:33.552309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7f926830-c523-4408-9bb8-6368c126cb66 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:33.555470 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7f926830-c523-4408-9bb8-6368c126cb66 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:33.564748 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f926830-c523-4408-9bb8-6368c126cb66 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:33.565692 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f926830-c523-4408-9bb8-6368c126cb66 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:33.566357 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f926830-c523-4408-9bb8-6368c126cb66 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:33.567473 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f926830-c523-4408-9bb8-6368c126cb66 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:33.568956 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f926830-c523-4408-9bb8-6368c126cb66 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:33.569638 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f926830-c523-4408-9bb8-6368c126cb66 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:33.572664 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7779ea0e-5348-4983-a7e0-4b54b6883862 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments/3f1c085f-cf99-4bfc-89de-19409bd4b4f5" status: 200 len: 194 microversion: 2.1 time: 0.053033 Aug 30 01:22:33.573264 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 297/590] 10.222.0.44 () {58 vars in 1413 bytes} [Tue Aug 30 01:22:33 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments/3f1c085f-cf99-4bfc-89de-19409bd4b4f5 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:33.584110 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8f788232-26bb-4d62-ab71-d846b45d226d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:33.584938 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8f788232-26bb-4d62-ab71-d846b45d226d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:33.591435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8f788232-26bb-4d62-ab71-d846b45d226d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:33.591930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8f788232-26bb-4d62-ab71-d846b45d226d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:33.592376 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8f788232-26bb-4d62-ab71-d846b45d226d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:33.593743 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8f788232-26bb-4d62-ab71-d846b45d226d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:33.594371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8f788232-26bb-4d62-ab71-d846b45d226d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:33.594790 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8f788232-26bb-4d62-ab71-d846b45d226d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:33.604927 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7f926830-c523-4408-9bb8-6368c126cb66 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058905 Aug 30 01:22:33.609506 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 294/591] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:22:33 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:33.695502 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-8f788232-26bb-4d62-ab71-d846b45d226d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lazy-loading 'services' on Instance uuid 9c71a84e-dc40-4fe0-a125-b4dd1749396f {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:22:33.752177 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4d042164-490f-4e45-8056-137faf833a26 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:33.753887 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4d042164-490f-4e45-8056-137faf833a26 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:33.762677 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d042164-490f-4e45-8056-137faf833a26 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:33.763758 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d042164-490f-4e45-8056-137faf833a26 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:33.765661 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d042164-490f-4e45-8056-137faf833a26 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:33.766817 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d042164-490f-4e45-8056-137faf833a26 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:33.768657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d042164-490f-4e45-8056-137faf833a26 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:33.769360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d042164-490f-4e45-8056-137faf833a26 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:33.779408 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8f788232-26bb-4d62-ab71-d846b45d226d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments/3f1c085f-cf99-4bfc-89de-19409bd4b4f5" status: 202 len: 0 microversion: 2.1 time: 0.198983 Aug 30 01:22:33.781179 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 298/592] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Aug 30 01:22:33 2022] DELETE /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments/3f1c085f-cf99-4bfc-89de-19409bd4b4f5 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:22:34.008735 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4d042164-490f-4e45-8056-137faf833a26 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:34.017136 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4d042164-490f-4e45-8056-137faf833a26 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1569 microversion: 2.1 time: 0.273128 Aug 30 01:22:34.017697 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 295/593] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:33 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1569 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:34.037906 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9109af5e-348d-469a-b57b-a1acadab6e68 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:34.038590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9109af5e-348d-469a-b57b-a1acadab6e68 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:34.044901 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9109af5e-348d-469a-b57b-a1acadab6e68 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:34.045384 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9109af5e-348d-469a-b57b-a1acadab6e68 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:34.045820 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9109af5e-348d-469a-b57b-a1acadab6e68 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:34.046652 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9109af5e-348d-469a-b57b-a1acadab6e68 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:34.047114 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9109af5e-348d-469a-b57b-a1acadab6e68 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:34.047536 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9109af5e-348d-469a-b57b-a1acadab6e68 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:34.091784 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9109af5e-348d-469a-b57b-a1acadab6e68 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120705) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 01:22:34.160690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9109af5e-348d-469a-b57b-a1acadab6e68 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "POST /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd/action" status: 202 len: 0 microversion: 2.1 time: 0.127044 Aug 30 01:22:34.161626 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 299/594] 10.222.0.44 () {60 vars in 1278 bytes} [Tue Aug 30 01:22:34 2022] POST /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:22:34.169836 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c0093883-945d-436a-a152-45579e2de478 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:34.170719 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c0093883-945d-436a-a152-45579e2de478 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:34.178544 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0093883-945d-436a-a152-45579e2de478 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:34.179261 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0093883-945d-436a-a152-45579e2de478 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:34.179690 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0093883-945d-436a-a152-45579e2de478 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:34.180434 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0093883-945d-436a-a152-45579e2de478 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:34.180882 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0093883-945d-436a-a152-45579e2de478 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:34.181335 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0093883-945d-436a-a152-45579e2de478 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:34.318431 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c0093883-945d-436a-a152-45579e2de478 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:34.326341 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c0093883-945d-436a-a152-45579e2de478 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1577 microversion: 2.1 time: 0.160568 Aug 30 01:22:34.326916 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 296/595] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:34 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:34.617592 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6454a5f4-01dc-4505-9bf2-e9ec5e0fedc3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:34.620256 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6454a5f4-01dc-4505-9bf2-e9ec5e0fedc3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:34.627909 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6454a5f4-01dc-4505-9bf2-e9ec5e0fedc3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:34.628535 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6454a5f4-01dc-4505-9bf2-e9ec5e0fedc3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:34.628943 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6454a5f4-01dc-4505-9bf2-e9ec5e0fedc3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:34.629557 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6454a5f4-01dc-4505-9bf2-e9ec5e0fedc3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:34.630002 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6454a5f4-01dc-4505-9bf2-e9ec5e0fedc3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:34.630423 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6454a5f4-01dc-4505-9bf2-e9ec5e0fedc3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:34.663300 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6454a5f4-01dc-4505-9bf2-e9ec5e0fedc3 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049884 Aug 30 01:22:34.663861 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 300/596] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:22:34 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:22:34.674728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-33ffa4fd-d36e-4b14-8112-711352fdb30d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:34.675297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-33ffa4fd-d36e-4b14-8112-711352fdb30d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:34.681772 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-33ffa4fd-d36e-4b14-8112-711352fdb30d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:34.682252 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-33ffa4fd-d36e-4b14-8112-711352fdb30d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:34.682680 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-33ffa4fd-d36e-4b14-8112-711352fdb30d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:34.683359 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-33ffa4fd-d36e-4b14-8112-711352fdb30d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:34.683800 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-33ffa4fd-d36e-4b14-8112-711352fdb30d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:34.684443 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-33ffa4fd-d36e-4b14-8112-711352fdb30d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:34.767038 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-33ffa4fd-d36e-4b14-8112-711352fdb30d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] HTTP exception thrown: Instance c0f03d56-24a2-4446-8eec-c95cb2050d24 is not attached to volume 1955b77a-0c60-4b21-b7b6-12bed0405a04 Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-33ffa4fd-d36e-4b14-8112-711352fdb30d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Request method failure captured: Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: DELETE /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments/1955b77a-0c60-4b21-b7b6-12bed0405a04 HTTP/1.1 Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWW57FF_uTQejgVPjcsIOY0xDpbV-v-HVermHtOzzjJh78qG7oOzFHV-rQtk-XEeIkVmmNTOBK_gCzvrtkkCmEbVbK9CYTsx6bgYTaQFXi2gvr4_EtVnUol4zPPbVYMlLOlscWiDSKRk_5naYg4ayfUBEHeBVSPWacezcextmgIG4aI Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 91f4e4df4e2744bfb9fcd84431ed567e Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-TestMinimumBasicScenario-2020301418 Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:22:34.769647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:22:34.771321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91f4e4df4e2744bfb9fcd84431ed567e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91f4e4df4e2744bfb9fcd84431ed567e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/91f4e4df4e2744bfb9fcd84431ed567e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_91f4e4df4e2744bfb9fcd84431ed567e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:22:34.771321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-TestMinimumBasicScenario-2020301418 Aug 30 01:22:34.771321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 91f4e4df4e2744bfb9fcd84431ed567e Aug 30 01:22:34.771321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2020301418 Aug 30 01:22:34.771321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-TestMinimumBasicScenario-2020301418-project Aug 30 01:22:34.771321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:22:34.771321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:22:34.771321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: a21183e645d74e4f9378c650e7916ba8 Aug 30 01:22:34.771321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-TestMinimumBasicScenario-2020301418-project Aug 30 01:22:34.771321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:22:34.771321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance c0f03d56-24a2-4446-8eec-c95cb2050d24 is not attached to volume 1955b77a-0c60-4b21-b7b6-12bed0405a04 Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'server_id': 'c0f03d56-24a2-4446-8eec-c95cb2050d24', 'id': '1955b77a-0c60-4b21-b7b6-12bed0405a04'} Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1955b77a-0c60-4b21-b7b6-12bed0405a04. Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:22:34.775541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f03d56-24a2-4446-8eec-c95cb2050d24 is not attached to volume 1955b77a-0c60-4b21-b7b6-12bed0405a04 Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f03d56-24a2-4446-8eec-c95cb2050d24 is not attached to volume 1955b77a-0c60-4b21-b7b6-12bed0405a04 Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:34.777145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-33ffa4fd-d36e-4b14-8112-711352fdb30d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Returning 404 to user: Instance c0f03d56-24a2-4446-8eec-c95cb2050d24 is not attached to volume 1955b77a-0c60-4b21-b7b6-12bed0405a04 {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:22:34.778708 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-33ffa4fd-d36e-4b14-8112-711352fdb30d tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments/1955b77a-0c60-4b21-b7b6-12bed0405a04" status: 404 len: 154 microversion: 2.1 time: 0.100994 Aug 30 01:22:34.778708 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 297/597] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Aug 30 01:22:34 2022] DELETE /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24/os-volume_attachments/1955b77a-0c60-4b21-b7b6-12bed0405a04 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:35.348090 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b25a5043-da6b-47a1-8c66-0baaa336c220 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:35.349006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b25a5043-da6b-47a1-8c66-0baaa336c220 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:35.355509 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b25a5043-da6b-47a1-8c66-0baaa336c220 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:35.356115 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b25a5043-da6b-47a1-8c66-0baaa336c220 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:35.356546 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b25a5043-da6b-47a1-8c66-0baaa336c220 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:35.357259 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b25a5043-da6b-47a1-8c66-0baaa336c220 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:35.357705 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b25a5043-da6b-47a1-8c66-0baaa336c220 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:35.358207 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b25a5043-da6b-47a1-8c66-0baaa336c220 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:35.490540 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b25a5043-da6b-47a1-8c66-0baaa336c220 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:35.498463 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b25a5043-da6b-47a1-8c66-0baaa336c220 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1519 microversion: 2.1 time: 0.155304 Aug 30 01:22:35.499042 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 301/598] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:35 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:35.926720 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c8b61beb-a705-4f92-a1a6-a746c5b9f6f9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:35.927906 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c8b61beb-a705-4f92-a1a6-a746c5b9f6f9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:35.937370 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8b61beb-a705-4f92-a1a6-a746c5b9f6f9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:35.938009 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8b61beb-a705-4f92-a1a6-a746c5b9f6f9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:35.939203 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8b61beb-a705-4f92-a1a6-a746c5b9f6f9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:35.940598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8b61beb-a705-4f92-a1a6-a746c5b9f6f9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:35.941062 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8b61beb-a705-4f92-a1a6-a746c5b9f6f9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:35.941497 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8b61beb-a705-4f92-a1a6-a746c5b9f6f9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:35.969445 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c8b61beb-a705-4f92-a1a6-a746c5b9f6f9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:22:35.982256 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c1ab126e-7738-4002-9469-afb7586c90b7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:35.982745 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c1ab126e-7738-4002-9469-afb7586c90b7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:35.990508 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c1ab126e-7738-4002-9469-afb7586c90b7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:35.991004 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c1ab126e-7738-4002-9469-afb7586c90b7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:35.991448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c1ab126e-7738-4002-9469-afb7586c90b7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:35.992252 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c1ab126e-7738-4002-9469-afb7586c90b7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:35.992680 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c1ab126e-7738-4002-9469-afb7586c90b7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:35.993376 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c1ab126e-7738-4002-9469-afb7586c90b7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:36.024795 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c1ab126e-7738-4002-9469-afb7586c90b7 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments/21622bd8-7b94-4155-9731-a4f430e56ec9" status: 200 len: 194 microversion: 2.1 time: 0.046255 Aug 30 01:22:36.031316 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 302/599] 10.222.0.44 () {58 vars in 1413 bytes} [Tue Aug 30 01:22:35 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments/21622bd8-7b94-4155-9731-a4f430e56ec9 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:36.037952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1634413f-59c0-4b6b-8e64-f36e85d0beb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:36.038452 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1634413f-59c0-4b6b-8e64-f36e85d0beb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:36.044481 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1634413f-59c0-4b6b-8e64-f36e85d0beb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:36.044972 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1634413f-59c0-4b6b-8e64-f36e85d0beb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:36.045583 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1634413f-59c0-4b6b-8e64-f36e85d0beb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:36.046462 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1634413f-59c0-4b6b-8e64-f36e85d0beb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:36.047087 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1634413f-59c0-4b6b-8e64-f36e85d0beb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:36.048338 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1634413f-59c0-4b6b-8e64-f36e85d0beb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:36.060557 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c8b61beb-a705-4f92-a1a6-a746c5b9f6f9 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 204 len: 0 microversion: 2.1 time: 0.138000 Aug 30 01:22:36.061336 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 298/600] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:22:35 2022] DELETE /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:22:36.070578 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cc5f1af9-7158-4c2c-9e8a-acabf17be567 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:36.071313 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cc5f1af9-7158-4c2c-9e8a-acabf17be567 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:36.078517 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc5f1af9-7158-4c2c-9e8a-acabf17be567 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:36.079609 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc5f1af9-7158-4c2c-9e8a-acabf17be567 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:36.080188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc5f1af9-7158-4c2c-9e8a-acabf17be567 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:36.081171 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc5f1af9-7158-4c2c-9e8a-acabf17be567 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:36.081658 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc5f1af9-7158-4c2c-9e8a-acabf17be567 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:36.082103 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc5f1af9-7158-4c2c-9e8a-acabf17be567 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:36.169161 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-1634413f-59c0-4b6b-8e64-f36e85d0beb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lazy-loading 'services' on Instance uuid 9c71a84e-dc40-4fe0-a125-b4dd1749396f {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:22:36.243725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cc5f1af9-7158-4c2c-9e8a-acabf17be567 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:36.252221 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1634413f-59c0-4b6b-8e64-f36e85d0beb4 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments/21622bd8-7b94-4155-9731-a4f430e56ec9" status: 202 len: 0 microversion: 2.1 time: 0.218058 Aug 30 01:22:36.252585 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cc5f1af9-7158-4c2c-9e8a-acabf17be567 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1554 microversion: 2.1 time: 0.186133 Aug 30 01:22:36.252849 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 303/601] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Aug 30 01:22:36 2022] DELETE /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments/21622bd8-7b94-4155-9731-a4f430e56ec9 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:22:36.253825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 299/602] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:36 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:36.521542 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c25a1500-789a-45fa-9604-64d42ab03351 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:36.522170 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c25a1500-789a-45fa-9604-64d42ab03351 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:36.528396 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c25a1500-789a-45fa-9604-64d42ab03351 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:36.528879 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c25a1500-789a-45fa-9604-64d42ab03351 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:36.529315 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c25a1500-789a-45fa-9604-64d42ab03351 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:36.530000 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c25a1500-789a-45fa-9604-64d42ab03351 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:36.530453 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c25a1500-789a-45fa-9604-64d42ab03351 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:36.530876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c25a1500-789a-45fa-9604-64d42ab03351 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:36.668657 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c25a1500-789a-45fa-9604-64d42ab03351 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:36.676874 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c25a1500-789a-45fa-9604-64d42ab03351 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.159876 Aug 30 01:22:36.677464 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 304/603] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:36 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:37.018509 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-a3931175-80df-4e96-a49a-082d9b32b971 req-689aed52-ad2c-4ac6-8259-96973409ffa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68833d42-7eed-4b4c-b315-842b9c015dfd", "name": "network-vif-unplugged", "status": "completed", "tag": "90cf8014-421d-45c2-8701-cc67f5ad29d1"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:37.029382 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a3931175-80df-4e96-a49a-082d9b32b971 req-689aed52-ad2c-4ac6-8259-96973409ffa6 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:37.029899 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a3931175-80df-4e96-a49a-082d9b32b971 req-689aed52-ad2c-4ac6-8259-96973409ffa6 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:37.030379 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a3931175-80df-4e96-a49a-082d9b32b971 req-689aed52-ad2c-4ac6-8259-96973409ffa6 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:37.042450 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-a3931175-80df-4e96-a49a-082d9b32b971 req-689aed52-ad2c-4ac6-8259-96973409ffa6 service nova] Creating event network-vif-unplugged:90cf8014-421d-45c2-8701-cc67f5ad29d1 for instance 68833d42-7eed-4b4c-b315-842b9c015dfd on hv-cinder-81514 Aug 30 01:22:37.047265 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-a3931175-80df-4e96-a49a-082d9b32b971 req-689aed52-ad2c-4ac6-8259-96973409ffa6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032405 Aug 30 01:22:37.048754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 300/604] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:37.274792 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8d8df212-c926-4052-b74c-874aedfcedfd tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:37.275379 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8d8df212-c926-4052-b74c-874aedfcedfd tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:37.281767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d8df212-c926-4052-b74c-874aedfcedfd tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:37.282240 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d8df212-c926-4052-b74c-874aedfcedfd tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:37.282669 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d8df212-c926-4052-b74c-874aedfcedfd tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:37.283345 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d8df212-c926-4052-b74c-874aedfcedfd tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:37.283788 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d8df212-c926-4052-b74c-874aedfcedfd tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:37.284229 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d8df212-c926-4052-b74c-874aedfcedfd tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:37.413232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8d8df212-c926-4052-b74c-874aedfcedfd tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:37.420891 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8d8df212-c926-4052-b74c-874aedfcedfd tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1554 microversion: 2.1 time: 0.149899 Aug 30 01:22:37.421450 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 305/605] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:37 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:37.698522 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7168330a-55c6-4fa2-a00f-da87164dc4e8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:37.699222 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7168330a-55c6-4fa2-a00f-da87164dc4e8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:37.705786 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7168330a-55c6-4fa2-a00f-da87164dc4e8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:37.706309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7168330a-55c6-4fa2-a00f-da87164dc4e8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:37.706808 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7168330a-55c6-4fa2-a00f-da87164dc4e8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:37.707375 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7168330a-55c6-4fa2-a00f-da87164dc4e8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:37.708021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7168330a-55c6-4fa2-a00f-da87164dc4e8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:37.708599 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7168330a-55c6-4fa2-a00f-da87164dc4e8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:37.842747 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7168330a-55c6-4fa2-a00f-da87164dc4e8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:37.851244 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7168330a-55c6-4fa2-a00f-da87164dc4e8 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.156933 Aug 30 01:22:37.851805 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 301/606] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:37 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:37.946660 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-26c5959d-929a-4789-a5cb-a92b780d5394 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:37.947158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-26c5959d-929a-4789-a5cb-a92b780d5394 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:37.953221 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26c5959d-929a-4789-a5cb-a92b780d5394 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:37.954142 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26c5959d-929a-4789-a5cb-a92b780d5394 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:37.954731 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26c5959d-929a-4789-a5cb-a92b780d5394 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:37.955251 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26c5959d-929a-4789-a5cb-a92b780d5394 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:37.955734 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26c5959d-929a-4789-a5cb-a92b780d5394 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:37.956190 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26c5959d-929a-4789-a5cb-a92b780d5394 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:37.982208 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-26c5959d-929a-4789-a5cb-a92b780d5394 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:22:38.012298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:38.066336 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-26c5959d-929a-4789-a5cb-a92b780d5394 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 204 len: 0 microversion: 2.1 time: 0.123350 Aug 30 01:22:38.066933 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 306/607] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:22:37 2022] DELETE /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:22:38.075522 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-94290df2-b961-4b47-9eb8-daee73fc3b0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:38.077278 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-94290df2-b961-4b47-9eb8-daee73fc3b0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:38.084993 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-94290df2-b961-4b47-9eb8-daee73fc3b0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:38.085754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-94290df2-b961-4b47-9eb8-daee73fc3b0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:38.086202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-94290df2-b961-4b47-9eb8-daee73fc3b0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:38.086922 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-94290df2-b961-4b47-9eb8-daee73fc3b0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:38.087485 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-94290df2-b961-4b47-9eb8-daee73fc3b0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:38.087912 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-94290df2-b961-4b47-9eb8-daee73fc3b0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:38.227200 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-94290df2-b961-4b47-9eb8-daee73fc3b0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:38.235921 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-94290df2-b961-4b47-9eb8-daee73fc3b0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1575 microversion: 2.1 time: 0.163983 Aug 30 01:22:38.236537 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 302/608] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:38 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:38.443046 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-87b7759e-ca8d-4f2e-ae67-023d0298ea07 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:38.443831 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-87b7759e-ca8d-4f2e-ae67-023d0298ea07 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:38.450301 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-87b7759e-ca8d-4f2e-ae67-023d0298ea07 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:38.450785 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-87b7759e-ca8d-4f2e-ae67-023d0298ea07 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:38.451222 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-87b7759e-ca8d-4f2e-ae67-023d0298ea07 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:38.451902 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-87b7759e-ca8d-4f2e-ae67-023d0298ea07 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:38.452380 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-87b7759e-ca8d-4f2e-ae67-023d0298ea07 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:38.452802 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-87b7759e-ca8d-4f2e-ae67-023d0298ea07 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:38.587831 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-87b7759e-ca8d-4f2e-ae67-023d0298ea07 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:38.595522 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-87b7759e-ca8d-4f2e-ae67-023d0298ea07 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1554 microversion: 2.1 time: 0.157261 Aug 30 01:22:38.596113 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 307/609] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:38 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:38.873823 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-51323b74-8738-4751-b525-37b02de5da83 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:38.874349 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-51323b74-8738-4751-b525-37b02de5da83 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:38.882004 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51323b74-8738-4751-b525-37b02de5da83 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:38.882483 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51323b74-8738-4751-b525-37b02de5da83 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:38.882914 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51323b74-8738-4751-b525-37b02de5da83 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:38.883605 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51323b74-8738-4751-b525-37b02de5da83 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:38.884073 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51323b74-8738-4751-b525-37b02de5da83 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:38.884525 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51323b74-8738-4751-b525-37b02de5da83 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:38.888554 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:39.023709 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-51323b74-8738-4751-b525-37b02de5da83 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:39.031558 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-51323b74-8738-4751-b525-37b02de5da83 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.161719 Aug 30 01:22:39.032164 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 303/610] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:38 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:39.257685 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-eadc4a76-e3ed-4643-a3ad-5ee421f94ac4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:39.258282 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-eadc4a76-e3ed-4643-a3ad-5ee421f94ac4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:39.264249 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eadc4a76-e3ed-4643-a3ad-5ee421f94ac4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:39.264726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eadc4a76-e3ed-4643-a3ad-5ee421f94ac4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:39.265157 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eadc4a76-e3ed-4643-a3ad-5ee421f94ac4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:39.265837 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eadc4a76-e3ed-4643-a3ad-5ee421f94ac4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:39.266285 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eadc4a76-e3ed-4643-a3ad-5ee421f94ac4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:39.266703 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eadc4a76-e3ed-4643-a3ad-5ee421f94ac4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:39.395361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-eadc4a76-e3ed-4643-a3ad-5ee421f94ac4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:39.403022 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-eadc4a76-e3ed-4643-a3ad-5ee421f94ac4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1575 microversion: 2.1 time: 0.149201 Aug 30 01:22:39.403581 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 308/611] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:39 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:39.616526 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-04ad47d1-9ade-400e-9ebd-9e1e3cfaf394 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:39.617256 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-04ad47d1-9ade-400e-9ebd-9e1e3cfaf394 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:39.624196 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04ad47d1-9ade-400e-9ebd-9e1e3cfaf394 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:39.624682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04ad47d1-9ade-400e-9ebd-9e1e3cfaf394 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:39.625119 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04ad47d1-9ade-400e-9ebd-9e1e3cfaf394 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:39.625852 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04ad47d1-9ade-400e-9ebd-9e1e3cfaf394 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:39.626300 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04ad47d1-9ade-400e-9ebd-9e1e3cfaf394 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:39.626715 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04ad47d1-9ade-400e-9ebd-9e1e3cfaf394 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:39.823428 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-04ad47d1-9ade-400e-9ebd-9e1e3cfaf394 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:39.834284 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-04ad47d1-9ade-400e-9ebd-9e1e3cfaf394 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1554 microversion: 2.1 time: 0.221550 Aug 30 01:22:39.834996 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 304/612] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:39 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1554 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:39.976959 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-430b67ff-321f-48eb-a5de-ea28eda7d397 req-d0c56478-855e-4b12-bc87-1c62d0b5dfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f03d56-24a2-4446-8eec-c95cb2050d24", "name": "network-vif-deleted", "tag": "481cfbb3-ad8c-4d71-a2e4-067031b651cb"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:39.986720 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-430b67ff-321f-48eb-a5de-ea28eda7d397 req-d0c56478-855e-4b12-bc87-1c62d0b5dfd9 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:39.987282 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-430b67ff-321f-48eb-a5de-ea28eda7d397 req-d0c56478-855e-4b12-bc87-1c62d0b5dfd9 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:39.987714 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-430b67ff-321f-48eb-a5de-ea28eda7d397 req-d0c56478-855e-4b12-bc87-1c62d0b5dfd9 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.000948 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-430b67ff-321f-48eb-a5de-ea28eda7d397 req-d0c56478-855e-4b12-bc87-1c62d0b5dfd9 service nova] Creating event network-vif-deleted:481cfbb3-ad8c-4d71-a2e4-067031b651cb for instance c0f03d56-24a2-4446-8eec-c95cb2050d24 on hv-cinder-81514 Aug 30 01:22:40.006217 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-430b67ff-321f-48eb-a5de-ea28eda7d397 req-d0c56478-855e-4b12-bc87-1c62d0b5dfd9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032907 Aug 30 01:22:40.006826 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 309/613] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:40.052743 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b7af5b36-3c3a-4054-a212-9a701b03e6c9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:40.053356 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b7af5b36-3c3a-4054-a212-9a701b03e6c9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:40.059442 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b7af5b36-3c3a-4054-a212-9a701b03e6c9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.059928 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b7af5b36-3c3a-4054-a212-9a701b03e6c9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.060392 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b7af5b36-3c3a-4054-a212-9a701b03e6c9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.061081 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b7af5b36-3c3a-4054-a212-9a701b03e6c9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.061531 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b7af5b36-3c3a-4054-a212-9a701b03e6c9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.061982 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b7af5b36-3c3a-4054-a212-9a701b03e6c9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.212241 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b7af5b36-3c3a-4054-a212-9a701b03e6c9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:40.220106 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b7af5b36-3c3a-4054-a212-9a701b03e6c9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.171217 Aug 30 01:22:40.220660 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 305/614] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:40 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:40.425826 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0ea94064-abaa-4244-bdd8-b31df9cd8a45 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:40.426796 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0ea94064-abaa-4244-bdd8-b31df9cd8a45 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:40.434600 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ea94064-abaa-4244-bdd8-b31df9cd8a45 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.436273 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ea94064-abaa-4244-bdd8-b31df9cd8a45 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.436738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ea94064-abaa-4244-bdd8-b31df9cd8a45 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.437546 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ea94064-abaa-4244-bdd8-b31df9cd8a45 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.439009 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ea94064-abaa-4244-bdd8-b31df9cd8a45 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.439613 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ea94064-abaa-4244-bdd8-b31df9cd8a45 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.665990 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dbe24f5d-7fcd-4919-88aa-878c400cc27b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:40.668606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-dbe24f5d-7fcd-4919-88aa-878c400cc27b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:40.678358 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbe24f5d-7fcd-4919-88aa-878c400cc27b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.678851 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbe24f5d-7fcd-4919-88aa-878c400cc27b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.679289 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbe24f5d-7fcd-4919-88aa-878c400cc27b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.680008 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbe24f5d-7fcd-4919-88aa-878c400cc27b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.691553 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbe24f5d-7fcd-4919-88aa-878c400cc27b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.692491 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbe24f5d-7fcd-4919-88aa-878c400cc27b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.708463 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0ea94064-abaa-4244-bdd8-b31df9cd8a45 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:40.721320 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0ea94064-abaa-4244-bdd8-b31df9cd8a45 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1575 microversion: 2.1 time: 0.298250 Aug 30 01:22:40.722418 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 310/615] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:40 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1575 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:40.737909 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dbe24f5d-7fcd-4919-88aa-878c400cc27b tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075789 Aug 30 01:22:40.738490 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 306/616] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:22:40 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 01:22:40.854769 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5e9030f7-6f95-4e01-8cdf-528bf16a28f1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:40.856965 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5e9030f7-6f95-4e01-8cdf-528bf16a28f1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:40.857697 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:40.858588 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:40.863676 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5e9030f7-6f95-4e01-8cdf-528bf16a28f1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.864230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5e9030f7-6f95-4e01-8cdf-528bf16a28f1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.864711 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5e9030f7-6f95-4e01-8cdf-528bf16a28f1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.865624 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5e9030f7-6f95-4e01-8cdf-528bf16a28f1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.866083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5e9030f7-6f95-4e01-8cdf-528bf16a28f1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.866385 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.866512 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5e9030f7-6f95-4e01-8cdf-528bf16a28f1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.866990 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.867496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.868536 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.869081 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.869848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.898588 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5e9030f7-6f95-4e01-8cdf-528bf16a28f1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047694 Aug 30 01:22:40.899195 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 311/617] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:22:40 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:22:40.904554 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.904554 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.904554 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.904827 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lazy-loading 'fault' on Instance uuid c0f03d56-24a2-4446-8eec-c95cb2050d24 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:22:40.961770 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21183e645d74e4f9378c650e7916ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f4e4df4e2744bfb9fcd84431ed567e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:40.972589 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-011c0721-e2a3-46b0-9d88-436dfcd5ae19 tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 200 len: 1347 microversion: 2.1 time: 0.118288 Aug 30 01:22:40.976253 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-05dbe202-06e7-428a-b700-28462c51c751 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:40.979062 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-05dbe202-06e7-428a-b700-28462c51c751 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:40.989510 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 307/618] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:40 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 1347 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:40.996077 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-05dbe202-06e7-428a-b700-28462c51c751 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.996899 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-05dbe202-06e7-428a-b700-28462c51c751 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.998567 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-05dbe202-06e7-428a-b700-28462c51c751 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.999279 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-05dbe202-06e7-428a-b700-28462c51c751 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:41.001308 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-05dbe202-06e7-428a-b700-28462c51c751 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:41.001945 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-05dbe202-06e7-428a-b700-28462c51c751 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:41.036800 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-05dbe202-06e7-428a-b700-28462c51c751 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:22:41.138272 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-05dbe202-06e7-428a-b700-28462c51c751 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 204 len: 0 microversion: 2.1 time: 0.171886 Aug 30 01:22:41.139336 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 312/619] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:22:40 2022] DELETE /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:22:41.150125 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-daca9dec-68b1-4765-852a-13a9642c841e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:41.150754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-daca9dec-68b1-4765-852a-13a9642c841e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:41.157337 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-daca9dec-68b1-4765-852a-13a9642c841e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:41.157980 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-daca9dec-68b1-4765-852a-13a9642c841e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:41.158168 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-daca9dec-68b1-4765-852a-13a9642c841e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:41.159068 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-daca9dec-68b1-4765-852a-13a9642c841e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:41.159826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-daca9dec-68b1-4765-852a-13a9642c841e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:41.160444 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-daca9dec-68b1-4765-852a-13a9642c841e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:41.242237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-80088fe8-1c0f-4844-a008-515f6cba9bcd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:41.243224 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-80088fe8-1c0f-4844-a008-515f6cba9bcd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:41.250127 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80088fe8-1c0f-4844-a008-515f6cba9bcd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:41.250616 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80088fe8-1c0f-4844-a008-515f6cba9bcd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:41.251251 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80088fe8-1c0f-4844-a008-515f6cba9bcd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:41.251972 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80088fe8-1c0f-4844-a008-515f6cba9bcd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:41.252451 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80088fe8-1c0f-4844-a008-515f6cba9bcd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:41.252873 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80088fe8-1c0f-4844-a008-515f6cba9bcd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:41.381304 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-daca9dec-68b1-4765-852a-13a9642c841e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:41.389821 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-daca9dec-68b1-4765-852a-13a9642c841e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1673 microversion: 2.1 time: 0.244553 Aug 30 01:22:41.390088 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-80088fe8-1c0f-4844-a008-515f6cba9bcd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:41.390607 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 308/620] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:41 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1673 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:41.411899 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-80088fe8-1c0f-4844-a008-515f6cba9bcd tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.173923 Aug 30 01:22:41.412510 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 313/621] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:41 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:41.742362 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6aa1bb74-f298-49a7-9141-d50a2eab45fa tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:41.743159 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6aa1bb74-f298-49a7-9141-d50a2eab45fa tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:41.749586 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6aa1bb74-f298-49a7-9141-d50a2eab45fa tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:41.750077 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6aa1bb74-f298-49a7-9141-d50a2eab45fa tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:41.750667 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6aa1bb74-f298-49a7-9141-d50a2eab45fa tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:41.751221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6aa1bb74-f298-49a7-9141-d50a2eab45fa tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:41.751678 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6aa1bb74-f298-49a7-9141-d50a2eab45fa tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:41.752134 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6aa1bb74-f298-49a7-9141-d50a2eab45fa tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:41.815935 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6aa1bb74-f298-49a7-9141-d50a2eab45fa tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:41.823726 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6aa1bb74-f298-49a7-9141-d50a2eab45fa tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1507 microversion: 2.1 time: 0.085355 Aug 30 01:22:41.824540 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 309/622] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:41 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1507 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:42.002626 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b8907936-26fe-4782-8d55-0534266e6afe tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:42.003240 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b8907936-26fe-4782-8d55-0534266e6afe tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] [instance: c0f03d56-24a2-4446-8eec-c95cb2050d24] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:42.009652 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8907936-26fe-4782-8d55-0534266e6afe tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:42.010129 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8907936-26fe-4782-8d55-0534266e6afe tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:42.010562 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8907936-26fe-4782-8d55-0534266e6afe tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:42.011252 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8907936-26fe-4782-8d55-0534266e6afe tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:42.011695 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8907936-26fe-4782-8d55-0534266e6afe tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:42.012139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b8907936-26fe-4782-8d55-0534266e6afe tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:42.022087 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-32ff1285-ae84-462f-9254-82eebe8cc4e1 req-f9b19acf-436a-4003-a2bb-0b5273a96db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "806ac720-5f83-41ac-8053-3debfda5295d", "name": "network-vif-deleted", "tag": "f8872fed-3b35-451c-ae5b-1a2e7790acd0"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:42.026683 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-b8907936-26fe-4782-8d55-0534266e6afe tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] HTTP exception thrown: Instance c0f03d56-24a2-4446-8eec-c95cb2050d24 could not be found. Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b8907936-26fe-4782-8d55-0534266e6afe tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Request method failure captured: Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 HTTP/1.1 Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWW57FF_uTQejgVPjcsIOY0xDpbV-v-HVermHtOzzjJh78qG7oOzFHV-rQtk-XEeIkVmmNTOBK_gCzvrtkkCmEbVbK9CYTsx6bgYTaQFXi2gvr4_EtVnUol4zPPbVYMlLOlscWiDSKRk_5naYg4ayfUBEHeBVSPWacezcextmgIG4aI Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: 91f4e4df4e2744bfb9fcd84431ed567e Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-TestMinimumBasicScenario-2020301418 Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:22:42.028350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:22:42.029618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91f4e4df4e2744bfb9fcd84431ed567e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/91f4e4df4e2744bfb9fcd84431ed567e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/91f4e4df4e2744bfb9fcd84431ed567e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_91f4e4df4e2744bfb9fcd84431ed567e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:22:42.029618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-TestMinimumBasicScenario-2020301418 Aug 30 01:22:42.029618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 91f4e4df4e2744bfb9fcd84431ed567e Aug 30 01:22:42.029618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2020301418 Aug 30 01:22:42.029618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-TestMinimumBasicScenario-2020301418-project Aug 30 01:22:42.029618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:22:42.029618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:22:42.029618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: a21183e645d74e4f9378c650e7916ba8 Aug 30 01:22:42.029618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-TestMinimumBasicScenario-2020301418-project Aug 30 01:22:42.029618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:22:42.029618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance c0f03d56-24a2-4446-8eec-c95cb2050d24 could not be found. Aug 30 01:22:42.029618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': 'c0f03d56-24a2-4446-8eec-c95cb2050d24'} Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f03d56-24a2-4446-8eec-c95cb2050d24 could not be found. Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:22:42.030371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f03d56-24a2-4446-8eec-c95cb2050d24 could not be found. Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f03d56-24a2-4446-8eec-c95cb2050d24 could not be found. Aug 30 01:22:42.032267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:42.033374 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b8907936-26fe-4782-8d55-0534266e6afe tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Returning 404 to user: Instance c0f03d56-24a2-4446-8eec-c95cb2050d24 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:22:42.033374 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b8907936-26fe-4782-8d55-0534266e6afe tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24" status: 404 len: 111 microversion: 2.1 time: 0.031119 Aug 30 01:22:42.033374 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 314/623] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:41 2022] GET /compute/v2.1/servers/c0f03d56-24a2-4446-8eec-c95cb2050d24 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:42.036534 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-32ff1285-ae84-462f-9254-82eebe8cc4e1 req-f9b19acf-436a-4003-a2bb-0b5273a96db3 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:42.037124 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-32ff1285-ae84-462f-9254-82eebe8cc4e1 req-f9b19acf-436a-4003-a2bb-0b5273a96db3 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:42.037655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-32ff1285-ae84-462f-9254-82eebe8cc4e1 req-f9b19acf-436a-4003-a2bb-0b5273a96db3 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:42.038769 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-79111a88-f0e3-4310-a68c-67e583c6486b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] Calling method '.version_select at 0x7ff48ad5e8b0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:42.050480 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-32ff1285-ae84-462f-9254-82eebe8cc4e1 req-f9b19acf-436a-4003-a2bb-0b5273a96db3 service nova] Creating event network-vif-deleted:f8872fed-3b35-451c-ae5b-1a2e7790acd0 for instance 806ac720-5f83-41ac-8053-3debfda5295d on hv-cinder-81514 Aug 30 01:22:42.055767 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-32ff1285-ae84-462f-9254-82eebe8cc4e1 req-f9b19acf-436a-4003-a2bb-0b5273a96db3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037546 Aug 30 01:22:42.056679 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 310/624] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:22:42.058508 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-79111a88-f0e3-4310-a68c-67e583c6486b tempest-TestMinimumBasicScenario-2020301418 tempest-TestMinimumBasicScenario-2020301418-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-259051794" status: 202 len: 0 microversion: 2.1 time: 0.023263 Aug 30 01:22:42.059322 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 315/625] 10.222.0.44 () {58 vars in 1269 bytes} [Tue Aug 30 01:22:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-259051794 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:22:42.411671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a71e436d-62f7-4c84-a85f-18be76682a8d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:42.412373 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a71e436d-62f7-4c84-a85f-18be76682a8d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:42.418678 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a71e436d-62f7-4c84-a85f-18be76682a8d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:42.419156 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a71e436d-62f7-4c84-a85f-18be76682a8d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:42.422157 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a71e436d-62f7-4c84-a85f-18be76682a8d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:42.423211 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a71e436d-62f7-4c84-a85f-18be76682a8d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:42.423672 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a71e436d-62f7-4c84-a85f-18be76682a8d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:42.424422 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a71e436d-62f7-4c84-a85f-18be76682a8d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:42.434021 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2a1bc8c6-ae7b-4cad-b1c4-ef1679c093ff tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:42.434962 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2a1bc8c6-ae7b-4cad-b1c4-ef1679c093ff tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:42.445381 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a1bc8c6-ae7b-4cad-b1c4-ef1679c093ff tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:42.446196 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a1bc8c6-ae7b-4cad-b1c4-ef1679c093ff tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:42.446863 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a1bc8c6-ae7b-4cad-b1c4-ef1679c093ff tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:42.447729 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a1bc8c6-ae7b-4cad-b1c4-ef1679c093ff tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:42.448518 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a1bc8c6-ae7b-4cad-b1c4-ef1679c093ff tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:42.449107 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a1bc8c6-ae7b-4cad-b1c4-ef1679c093ff tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:42.593513 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a71e436d-62f7-4c84-a85f-18be76682a8d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:42.604870 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a71e436d-62f7-4c84-a85f-18be76682a8d tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1673 microversion: 2.1 time: 0.197525 Aug 30 01:22:42.605659 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 311/626] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:42 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:42.633541 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2a1bc8c6-ae7b-4cad-b1c4-ef1679c093ff tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:42.641828 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2a1bc8c6-ae7b-4cad-b1c4-ef1679c093ff tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.212384 Aug 30 01:22:42.642404 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 316/627] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:42 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:42.847474 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-64356d7b-3afe-4153-ac4d-2cc9f4996587 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:42.848185 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-64356d7b-3afe-4153-ac4d-2cc9f4996587 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:42.854724 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-64356d7b-3afe-4153-ac4d-2cc9f4996587 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:42.855217 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-64356d7b-3afe-4153-ac4d-2cc9f4996587 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:42.855651 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-64356d7b-3afe-4153-ac4d-2cc9f4996587 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:42.856378 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-64356d7b-3afe-4153-ac4d-2cc9f4996587 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:42.856892 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-64356d7b-3afe-4153-ac4d-2cc9f4996587 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:42.859172 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-64356d7b-3afe-4153-ac4d-2cc9f4996587 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:42.961888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-64356d7b-3afe-4153-ac4d-2cc9f4996587 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:42.971588 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-64356d7b-3afe-4153-ac4d-2cc9f4996587 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1223 microversion: 2.1 time: 0.129044 Aug 30 01:22:42.972611 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 312/628] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:42 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1223 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:43.628478 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e3264c77-cefe-4af8-b95a-69b6f7b1dee1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:43.629097 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e3264c77-cefe-4af8-b95a-69b6f7b1dee1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:43.635638 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3264c77-cefe-4af8-b95a-69b6f7b1dee1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:43.636464 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3264c77-cefe-4af8-b95a-69b6f7b1dee1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:43.637141 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3264c77-cefe-4af8-b95a-69b6f7b1dee1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:43.638078 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3264c77-cefe-4af8-b95a-69b6f7b1dee1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:43.638764 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3264c77-cefe-4af8-b95a-69b6f7b1dee1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:43.639403 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3264c77-cefe-4af8-b95a-69b6f7b1dee1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:43.663821 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c487e457-0342-44c9-af3a-4b33c2e7dc02 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:43.664463 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c487e457-0342-44c9-af3a-4b33c2e7dc02 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:43.670635 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c487e457-0342-44c9-af3a-4b33c2e7dc02 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:43.671328 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c487e457-0342-44c9-af3a-4b33c2e7dc02 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:43.672155 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c487e457-0342-44c9-af3a-4b33c2e7dc02 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:43.673608 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c487e457-0342-44c9-af3a-4b33c2e7dc02 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:43.674281 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c487e457-0342-44c9-af3a-4b33c2e7dc02 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:43.674859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c487e457-0342-44c9-af3a-4b33c2e7dc02 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:43.897193 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c487e457-0342-44c9-af3a-4b33c2e7dc02 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:43.906161 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c487e457-0342-44c9-af3a-4b33c2e7dc02 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.246009 Aug 30 01:22:43.906755 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 313/629] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:43 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:43.997317 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:43.998434 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:44.009257 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:44.020158 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:44.020531 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:44.021292 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:44.021753 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:44.022179 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:44.057912 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:44.058740 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:44.059430 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:44.060140 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lazy-loading 'fault' on Instance uuid 806ac720-5f83-41ac-8053-3debfda5295d {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:22:44.131650 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:44.140819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cfec05ce-0219-4a2f-a717-33bc425bf9e5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 200 len: 1182 microversion: 2.1 time: 0.149028 Aug 30 01:22:44.141794 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 314/630] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:43 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 1182 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:44.189375 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e3264c77-cefe-4af8-b95a-69b6f7b1dee1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:44.201744 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e3264c77-cefe-4af8-b95a-69b6f7b1dee1 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1673 microversion: 2.1 time: 0.577498 Aug 30 01:22:44.202481 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 317/631] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:43 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1673 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:44.822367 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-33199202-8bd6-4bc1-bdfc-b333c76e67d3 req-7eea0d93-0fac-4a53-b93a-5dcd302ca965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c71a84e-dc40-4fe0-a125-b4dd1749396f", "name": "network-vif-deleted", "tag": "337b409d-a296-4c2d-9a34-bab9e39b72c4"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:44.847016 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-33199202-8bd6-4bc1-bdfc-b333c76e67d3 req-7eea0d93-0fac-4a53-b93a-5dcd302ca965 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:44.847828 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-33199202-8bd6-4bc1-bdfc-b333c76e67d3 req-7eea0d93-0fac-4a53-b93a-5dcd302ca965 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:44.848591 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-33199202-8bd6-4bc1-bdfc-b333c76e67d3 req-7eea0d93-0fac-4a53-b93a-5dcd302ca965 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:44.880378 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-33199202-8bd6-4bc1-bdfc-b333c76e67d3 req-7eea0d93-0fac-4a53-b93a-5dcd302ca965 service nova] Creating event network-vif-deleted:337b409d-a296-4c2d-9a34-bab9e39b72c4 for instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f on hv-cinder-81514 Aug 30 01:22:44.896424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-33199202-8bd6-4bc1-bdfc-b333c76e67d3 req-7eea0d93-0fac-4a53-b93a-5dcd302ca965 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203602 Aug 30 01:22:44.898346 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 315/632] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:44.928646 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f955bdea-3741-49da-88fb-914ede700f5b tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:44.929333 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f955bdea-3741-49da-88fb-914ede700f5b tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:44.959827 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f955bdea-3741-49da-88fb-914ede700f5b tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:44.960687 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f955bdea-3741-49da-88fb-914ede700f5b tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:44.961312 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f955bdea-3741-49da-88fb-914ede700f5b tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:44.962196 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f955bdea-3741-49da-88fb-914ede700f5b tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:44.963407 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f955bdea-3741-49da-88fb-914ede700f5b tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:44.964052 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f955bdea-3741-49da-88fb-914ede700f5b tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:45.162539 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7f251bc5-b972-40a1-b686-09515928fb52 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:45.164199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7f251bc5-b972-40a1-b686-09515928fb52 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:45.171546 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f251bc5-b972-40a1-b686-09515928fb52 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:45.173505 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f251bc5-b972-40a1-b686-09515928fb52 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:45.174167 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f251bc5-b972-40a1-b686-09515928fb52 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:45.175143 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f251bc5-b972-40a1-b686-09515928fb52 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:45.175824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f251bc5-b972-40a1-b686-09515928fb52 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:45.176544 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f251bc5-b972-40a1-b686-09515928fb52 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:45.202174 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-7f251bc5-b972-40a1-b686-09515928fb52 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] HTTP exception thrown: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7f251bc5-b972-40a1-b686-09515928fb52 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Request method failure captured: Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d HTTP/1.1 Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWWKG106_ye37k3Cc3N6VL7xjNtxZC6Z2Z1FBU4Q0VcVjnxhkf25XlB1qpGxx0dW38JLa-zrMhuoKgNq4y_H5VfBWkxmEn3b7hjbG5R-opms2i_s3X3OFnGoFIiChMZyEFAmYDMZOh8oyMKLRge1H0JCNzLR8Vvj3j-tdqRjPpTZ-Vs Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 20cdcff29a0448dc92460b2ddd45617b Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:22:45.206021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:22:45.207649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:22:45.207649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:22:45.207649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 20cdcff29a0448dc92460b2ddd45617b Aug 30 01:22:45.207649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:22:45.207649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-TestVolumeBootPattern-1380496173-project Aug 30 01:22:45.207649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:22:45.207649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:22:45.207649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 2839103f52324a1ab1ebd43fe230addc Aug 30 01:22:45.207649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-TestVolumeBootPattern-1380496173-project Aug 30 01:22:45.207649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:22:45.207649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:22:45.207649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '806ac720-5f83-41ac-8053-3debfda5295d'} Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:22:45.208576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:22:45.220055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:45.222087 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7f251bc5-b972-40a1-b686-09515928fb52 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Returning 404 to user: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:22:45.222087 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7f251bc5-b972-40a1-b686-09515928fb52 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 404 len: 111 microversion: 2.1 time: 0.059340 Aug 30 01:22:45.222087 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 316/633] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:45 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:22:45.236369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:45.237010 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:45.249364 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:45.250585 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:45.251152 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:45.251906 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:45.253384 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:45.253521 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:45.307528 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:45.308084 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:45.308529 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:45.311267 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lazy-loading 'fault' on Instance uuid 9c71a84e-dc40-4fe0-a125-b4dd1749396f {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:22:45.331513 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f955bdea-3741-49da-88fb-914ede700f5b tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:45.349273 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f955bdea-3741-49da-88fb-914ede700f5b tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.425978 Aug 30 01:22:45.350536 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 318/634] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:44 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:45.397576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5bd0cb311db42d7882a4cf90b0d85e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69f2b2876ed47459a8b960ff679c724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:45.424945 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2f9c2483-b4e9-4d6b-b447-e63d13b7b641 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 200 len: 1327 microversion: 2.1 time: 0.191223 Aug 30 01:22:45.425807 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 317/635] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:45 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 1327 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:45.446859 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-394814718", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-799326755", "security_groups": [{"name": "tempest-secgroup-smoke-1498413457"}], "block_device_mapping_v2": [{"uuid": "b6aa8b84-aa3f-4278-ae8f-9f817f8dade5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "12ed87b9-c5b4-42d2-a401-f5a13e16f9c3"}]}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:45.684602 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] validate_networks() for [('12ed87b9-c5b4-42d2-a401-f5a13e16f9c3', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:22:46.333380 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:22:46.333970 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:22:46.334319 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:22:46.334729 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:22:46.335134 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:22:46.345027 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:46.345562 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:46.345999 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:46.346720 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:46.347175 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:46.347599 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:46.366069 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Getting quotas for project 20cdcff29a0448dc92460b2ddd45617b. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:22:46.370270 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Getting quotas for user 2839103f52324a1ab1ebd43fe230addc and project 20cdcff29a0448dc92460b2ddd45617b. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:22:46.375192 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9ce4fb27-8bf3-447c-bceb-0945afa492f7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:46.377280 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9ce4fb27-8bf3-447c-bceb-0945afa492f7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:46.383165 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ce4fb27-8bf3-447c-bceb-0945afa492f7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:46.383588 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ce4fb27-8bf3-447c-bceb-0945afa492f7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:46.384107 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ce4fb27-8bf3-447c-bceb-0945afa492f7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:46.384766 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ce4fb27-8bf3-447c-bceb-0945afa492f7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:46.386159 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ce4fb27-8bf3-447c-bceb-0945afa492f7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:46.388579 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9ce4fb27-8bf3-447c-bceb-0945afa492f7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:46.455331 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:22:46.457615 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6aa8b84-aa3f-4278-ae8f-9f817f8dade5',volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:22:46.630932 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9ce4fb27-8bf3-447c-bceb-0945afa492f7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:46.638855 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9ce4fb27-8bf3-447c-bceb-0945afa492f7 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.268091 Aug 30 01:22:46.639438 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 318/636] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:46 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:46.661129 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4af24b99-47e0-44b5-8ef1-20b214df7508 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.217688 Aug 30 01:22:46.662061 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 319/637] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:22:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:22:46.668858 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-11f2fe62-ef65-47a6-a826-ff7a47cda115 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:46.672906 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-11f2fe62-ef65-47a6-a826-ff7a47cda115 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:46.680644 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0681b797-dabb-49c9-807e-f749d18d8657 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:46.681264 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0681b797-dabb-49c9-807e-f749d18d8657 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:46.694011 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11f2fe62-ef65-47a6-a826-ff7a47cda115 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:46.694843 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11f2fe62-ef65-47a6-a826-ff7a47cda115 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:46.696307 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11f2fe62-ef65-47a6-a826-ff7a47cda115 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:46.697232 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11f2fe62-ef65-47a6-a826-ff7a47cda115 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:46.697910 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11f2fe62-ef65-47a6-a826-ff7a47cda115 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:46.698558 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11f2fe62-ef65-47a6-a826-ff7a47cda115 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:46.730664 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-11f2fe62-ef65-47a6-a826-ff7a47cda115 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] HTTP exception thrown: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-11f2fe62-ef65-47a6-a826-ff7a47cda115 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Request method failure captured: Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f HTTP/1.1 Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWTxmiSmYqwnZa6dI51lhRZyg9VfWY5jMyqWbbiVTJDD_PMkAz0T3A8s2WrKUfgTsOAV_x2fzXXPp_brKmD04mnOtvXa-HrXzhr_IPfyR1M9WpjHFyf5zitccFqTf5eNw_zRZj9AF101W78_zLIKbLQSD9K9lbPWOwN34eRppA5vLJE Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: a69f2b2876ed47459a8b960ff679c724 Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:22:46.735221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:22:46.736603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:22:46.736603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:46.736603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: a69f2b2876ed47459a8b960ff679c724 Aug 30 01:22:46.736603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:46.736603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeTestJSON-706439447-project Aug 30 01:22:46.736603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:22:46.736603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:22:46.736603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: d5bd0cb311db42d7882a4cf90b0d85e8 Aug 30 01:22:46.736603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeTestJSON-706439447-project Aug 30 01:22:46.736603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:22:46.736603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:46.736603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '9c71a84e-dc40-4fe0-a125-b4dd1749396f'} Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:22:46.737319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:46.739610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:46.753109 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-11f2fe62-ef65-47a6-a826-ff7a47cda115 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Returning 404 to user: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:22:46.753109 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-11f2fe62-ef65-47a6-a826-ff7a47cda115 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 404 len: 111 microversion: 2.1 time: 0.086766 Aug 30 01:22:46.753109 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 319/638] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:46 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:46.753457 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0681b797-dabb-49c9-807e-f749d18d8657 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:46.755041 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3101225a-a0a9-4a3f-9c88-e9448df8c68e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '.version_select at 0x7ff48ad82040>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:46.760821 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0681b797-dabb-49c9-807e-f749d18d8657 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1093 microversion: 2.1 time: 0.091163 Aug 30 01:22:46.762581 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 320/639] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:46 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1093 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:46.801983 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3101225a-a0a9-4a3f-9c88-e9448df8c68e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-567082676" status: 202 len: 0 microversion: 2.1 time: 0.053687 Aug 30 01:22:46.803160 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 320/640] 10.222.0.44 () {58 vars in 1218 bytes} [Tue Aug 30 01:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-567082676 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:22:47.666667 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6ab5c106-f7af-460f-b447-2361a545b2ea tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:47.667271 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6ab5c106-f7af-460f-b447-2361a545b2ea tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:47.676304 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ab5c106-f7af-460f-b447-2361a545b2ea tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:47.677055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ab5c106-f7af-460f-b447-2361a545b2ea tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:47.677648 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ab5c106-f7af-460f-b447-2361a545b2ea tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:47.678679 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ab5c106-f7af-460f-b447-2361a545b2ea tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:47.679316 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ab5c106-f7af-460f-b447-2361a545b2ea tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:47.679887 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ab5c106-f7af-460f-b447-2361a545b2ea tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:47.785435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7f578871-acba-4e4f-882d-a3d186f8dc4b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:47.786874 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7f578871-acba-4e4f-882d-a3d186f8dc4b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:47.795456 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f578871-acba-4e4f-882d-a3d186f8dc4b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:47.796272 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f578871-acba-4e4f-882d-a3d186f8dc4b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:47.796864 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f578871-acba-4e4f-882d-a3d186f8dc4b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:47.797752 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f578871-acba-4e4f-882d-a3d186f8dc4b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:47.798212 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f578871-acba-4e4f-882d-a3d186f8dc4b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:47.798691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f578871-acba-4e4f-882d-a3d186f8dc4b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:47.860300 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6ab5c106-f7af-460f-b447-2361a545b2ea tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:47.868588 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6ab5c106-f7af-460f-b447-2361a545b2ea tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.206525 Aug 30 01:22:47.869162 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 321/641] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:47 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:47.894268 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7f578871-acba-4e4f-882d-a3d186f8dc4b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:47.901910 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7f578871-acba-4e4f-882d-a3d186f8dc4b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1191 microversion: 2.1 time: 0.123056 Aug 30 01:22:47.902508 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 321/642] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:47 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1191 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:48.893566 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f4aa6d0e-feed-4c7f-80ec-0a30003eb100 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:48.903375 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f4aa6d0e-feed-4c7f-80ec-0a30003eb100 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:48.915313 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f4aa6d0e-feed-4c7f-80ec-0a30003eb100 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:48.916128 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f4aa6d0e-feed-4c7f-80ec-0a30003eb100 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:48.916739 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f4aa6d0e-feed-4c7f-80ec-0a30003eb100 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:48.917592 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f4aa6d0e-feed-4c7f-80ec-0a30003eb100 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:48.918257 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f4aa6d0e-feed-4c7f-80ec-0a30003eb100 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:48.924919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-59ddb45d-249d-4e97-8b60-3e3504882b4f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:48.925649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-59ddb45d-249d-4e97-8b60-3e3504882b4f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:48.938607 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f4aa6d0e-feed-4c7f-80ec-0a30003eb100 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:48.951069 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59ddb45d-249d-4e97-8b60-3e3504882b4f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:48.951560 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59ddb45d-249d-4e97-8b60-3e3504882b4f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:48.952028 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59ddb45d-249d-4e97-8b60-3e3504882b4f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:48.959446 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59ddb45d-249d-4e97-8b60-3e3504882b4f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:48.963917 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59ddb45d-249d-4e97-8b60-3e3504882b4f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:48.964395 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59ddb45d-249d-4e97-8b60-3e3504882b4f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:49.028483 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:49.227698 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f4aa6d0e-feed-4c7f-80ec-0a30003eb100 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:49.256301 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f4aa6d0e-feed-4c7f-80ec-0a30003eb100 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.370891 Aug 30 01:22:49.258064 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 322/643] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:48 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:49.319055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-59ddb45d-249d-4e97-8b60-3e3504882b4f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:49.328957 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-59ddb45d-249d-4e97-8b60-3e3504882b4f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1277 microversion: 2.1 time: 0.408897 Aug 30 01:22:49.344233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 322/644] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:48 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1277 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:50.052986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2065c3ae-716a-40ec-8c7f-877bf517be18 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:50.054048 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2065c3ae-716a-40ec-8c7f-877bf517be18 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:50.061897 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2065c3ae-716a-40ec-8c7f-877bf517be18 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:50.062691 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2065c3ae-716a-40ec-8c7f-877bf517be18 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:50.063122 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2065c3ae-716a-40ec-8c7f-877bf517be18 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:50.064164 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2065c3ae-716a-40ec-8c7f-877bf517be18 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:50.064625 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2065c3ae-716a-40ec-8c7f-877bf517be18 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:50.065085 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2065c3ae-716a-40ec-8c7f-877bf517be18 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:50.081096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-2065c3ae-716a-40ec-8c7f-877bf517be18 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] HTTP exception thrown: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2065c3ae-716a-40ec-8c7f-877bf517be18 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Request method failure captured: Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f HTTP/1.1 Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWTxmiSmYqwnZa6dI51lhRZyg9VfWY5jMyqWbbiVTJDD_PMkAz0T3A8s2WrKUfgTsOAV_x2fzXXPp_brKmD04mnOtvXa-HrXzhr_IPfyR1M9WpjHFyf5zitccFqTf5eNw_zRZj9AF101W78_zLIKbLQSD9K9lbPWOwN34eRppA5vLJE Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: a69f2b2876ed47459a8b960ff679c724 Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:22:50.082650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:22:50.084146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:22:50.084146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:50.084146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: a69f2b2876ed47459a8b960ff679c724 Aug 30 01:22:50.084146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:50.084146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeTestJSON-706439447-project Aug 30 01:22:50.084146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:22:50.084146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:22:50.084146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: d5bd0cb311db42d7882a4cf90b0d85e8 Aug 30 01:22:50.084146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeTestJSON-706439447-project Aug 30 01:22:50.084146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:22:50.084146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:50.084146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '9c71a84e-dc40-4fe0-a125-b4dd1749396f'} Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:22:50.084928 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:50.086286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:50.087648 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2065c3ae-716a-40ec-8c7f-877bf517be18 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Returning 404 to user: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:22:50.087648 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2065c3ae-716a-40ec-8c7f-877bf517be18 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 404 len: 111 microversion: 2.1 time: 0.035344 Aug 30 01:22:50.087648 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 323/645] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:22:50 2022] DELETE /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:50.094113 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dea03dda-054e-4f93-bb90-2ddb4fb92ef0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:50.095138 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-dea03dda-054e-4f93-bb90-2ddb4fb92ef0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 9c71a84e-dc40-4fe0-a125-b4dd1749396f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:50.102589 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dea03dda-054e-4f93-bb90-2ddb4fb92ef0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:50.103081 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dea03dda-054e-4f93-bb90-2ddb4fb92ef0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:50.103520 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dea03dda-054e-4f93-bb90-2ddb4fb92ef0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:50.104253 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dea03dda-054e-4f93-bb90-2ddb4fb92ef0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:50.104960 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dea03dda-054e-4f93-bb90-2ddb4fb92ef0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:50.105396 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dea03dda-054e-4f93-bb90-2ddb4fb92ef0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:50.120176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-dea03dda-054e-4f93-bb90-2ddb4fb92ef0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] HTTP exception thrown: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dea03dda-054e-4f93-bb90-2ddb4fb92ef0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Request method failure captured: Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f HTTP/1.1 Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWTxmiSmYqwnZa6dI51lhRZyg9VfWY5jMyqWbbiVTJDD_PMkAz0T3A8s2WrKUfgTsOAV_x2fzXXPp_brKmD04mnOtvXa-HrXzhr_IPfyR1M9WpjHFyf5zitccFqTf5eNw_zRZj9AF101W78_zLIKbLQSD9K9lbPWOwN34eRppA5vLJE Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: a69f2b2876ed47459a8b960ff679c724 Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:22:50.121848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:22:50.123287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:22:50.123287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:50.123287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: a69f2b2876ed47459a8b960ff679c724 Aug 30 01:22:50.123287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:50.123287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeTestJSON-706439447-project Aug 30 01:22:50.123287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:22:50.123287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:22:50.123287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: d5bd0cb311db42d7882a4cf90b0d85e8 Aug 30 01:22:50.123287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeTestJSON-706439447-project Aug 30 01:22:50.123287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:22:50.123287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:50.123287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '9c71a84e-dc40-4fe0-a125-b4dd1749396f'} Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:22:50.124141 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. Aug 30 01:22:50.125671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:50.127033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dea03dda-054e-4f93-bb90-2ddb4fb92ef0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Returning 404 to user: Instance 9c71a84e-dc40-4fe0-a125-b4dd1749396f could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:22:50.127033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dea03dda-054e-4f93-bb90-2ddb4fb92ef0 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f" status: 404 len: 111 microversion: 2.1 time: 0.033608 Aug 30 01:22:50.127033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 323/646] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:50 2022] GET /compute/v2.1/servers/9c71a84e-dc40-4fe0-a125-b4dd1749396f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:50.279346 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3bac10bd-277f-4bd3-ad24-e75e3be5d489 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:50.279974 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3bac10bd-277f-4bd3-ad24-e75e3be5d489 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:50.286739 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3bac10bd-277f-4bd3-ad24-e75e3be5d489 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:50.287286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3bac10bd-277f-4bd3-ad24-e75e3be5d489 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:50.287655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3bac10bd-277f-4bd3-ad24-e75e3be5d489 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:50.288364 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3bac10bd-277f-4bd3-ad24-e75e3be5d489 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:50.288820 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3bac10bd-277f-4bd3-ad24-e75e3be5d489 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:50.289235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3bac10bd-277f-4bd3-ad24-e75e3be5d489 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:50.353106 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f6273105-f056-4ed9-960a-4546c7489609 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:50.354116 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f6273105-f056-4ed9-960a-4546c7489609 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:50.363554 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6273105-f056-4ed9-960a-4546c7489609 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:50.364653 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6273105-f056-4ed9-960a-4546c7489609 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:50.366352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6273105-f056-4ed9-960a-4546c7489609 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:50.367536 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6273105-f056-4ed9-960a-4546c7489609 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:50.368449 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6273105-f056-4ed9-960a-4546c7489609 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:50.369197 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6273105-f056-4ed9-960a-4546c7489609 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:50.547620 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f6273105-f056-4ed9-960a-4546c7489609 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:50.557135 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f6273105-f056-4ed9-960a-4546c7489609 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1265 microversion: 2.1 time: 0.208341 Aug 30 01:22:50.558066 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 324/647] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:50 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:50.619666 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-b3d2fb42-f89f-4727-a77b-2458cc6bcaee req-870d259a-18ca-4488-8193-14f183577735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0114fa80-59aa-458a-a4c3-6f49bdfa56bd", "tag": "a1ad209b-8fbb-43fc-9b1e-2133ae985606"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:50.632872 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b3d2fb42-f89f-4727-a77b-2458cc6bcaee req-870d259a-18ca-4488-8193-14f183577735 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:50.633804 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b3d2fb42-f89f-4727-a77b-2458cc6bcaee req-870d259a-18ca-4488-8193-14f183577735 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:50.634241 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b3d2fb42-f89f-4727-a77b-2458cc6bcaee req-870d259a-18ca-4488-8193-14f183577735 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:50.640959 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3bac10bd-277f-4bd3-ad24-e75e3be5d489 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:50.650771 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-b3d2fb42-f89f-4727-a77b-2458cc6bcaee req-870d259a-18ca-4488-8193-14f183577735 service nova] Creating event network-changed:a1ad209b-8fbb-43fc-9b1e-2133ae985606 for instance 0114fa80-59aa-458a-a4c3-6f49bdfa56bd on hv-cinder-81514 Aug 30 01:22:50.651816 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3bac10bd-277f-4bd3-ad24-e75e3be5d489 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.376394 Aug 30 01:22:50.652710 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 324/648] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:50 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:50.666519 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-b3d2fb42-f89f-4727-a77b-2458cc6bcaee req-870d259a-18ca-4488-8193-14f183577735 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050326 Aug 30 01:22:50.667340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 325/649] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:22:51.286009 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-27fd7693-c73a-490e-813c-3509349344f5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:51.286545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-27fd7693-c73a-490e-813c-3509349344f5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:51.294581 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-27fd7693-c73a-490e-813c-3509349344f5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:51.295078 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-27fd7693-c73a-490e-813c-3509349344f5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:51.295521 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-27fd7693-c73a-490e-813c-3509349344f5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:51.298062 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-27fd7693-c73a-490e-813c-3509349344f5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:51.298548 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-27fd7693-c73a-490e-813c-3509349344f5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:51.299096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-27fd7693-c73a-490e-813c-3509349344f5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:51.318855 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-27fd7693-c73a-490e-813c-3509349344f5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] HTTP exception thrown: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-27fd7693-c73a-490e-813c-3509349344f5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Request method failure captured: Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 HTTP/1.1 Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWTxmiSmYqwnZa6dI51lhRZyg9VfWY5jMyqWbbiVTJDD_PMkAz0T3A8s2WrKUfgTsOAV_x2fzXXPp_brKmD04mnOtvXa-HrXzhr_IPfyR1M9WpjHFyf5zitccFqTf5eNw_zRZj9AF101W78_zLIKbLQSD9K9lbPWOwN34eRppA5vLJE Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: a69f2b2876ed47459a8b960ff679c724 Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:22:51.320415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:22:51.322232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:22:51.322232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:51.322232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: a69f2b2876ed47459a8b960ff679c724 Aug 30 01:22:51.322232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:51.322232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeTestJSON-706439447-project Aug 30 01:22:51.322232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:22:51.322232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:22:51.322232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: d5bd0cb311db42d7882a4cf90b0d85e8 Aug 30 01:22:51.322232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeTestJSON-706439447-project Aug 30 01:22:51.322232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:22:51.322232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:22:51.322232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '6657e20f-b2a0-4f01-9dca-fd276792dc73'} Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:22:51.323286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:22:51.325655 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:22:51.327109 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-27fd7693-c73a-490e-813c-3509349344f5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Returning 404 to user: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:22:51.327109 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-27fd7693-c73a-490e-813c-3509349344f5 tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 404 len: 111 microversion: 2.1 time: 0.040619 Aug 30 01:22:51.327109 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 325/650] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:22:51 2022] DELETE /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:51.332878 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4ac0668f-18a3-4974-9857-7c1ec961a70e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:51.333581 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4ac0668f-18a3-4974-9857-7c1ec961a70e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] [instance: 6657e20f-b2a0-4f01-9dca-fd276792dc73] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:51.340788 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ac0668f-18a3-4974-9857-7c1ec961a70e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:51.341229 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ac0668f-18a3-4974-9857-7c1ec961a70e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:51.341661 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ac0668f-18a3-4974-9857-7c1ec961a70e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:51.342462 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ac0668f-18a3-4974-9857-7c1ec961a70e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:51.343357 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ac0668f-18a3-4974-9857-7c1ec961a70e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:51.343905 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ac0668f-18a3-4974-9857-7c1ec961a70e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:51.358250 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-4ac0668f-18a3-4974-9857-7c1ec961a70e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] HTTP exception thrown: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4ac0668f-18a3-4974-9857-7c1ec961a70e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Request method failure captured: Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 HTTP/1.1 Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWTxmiSmYqwnZa6dI51lhRZyg9VfWY5jMyqWbbiVTJDD_PMkAz0T3A8s2WrKUfgTsOAV_x2fzXXPp_brKmD04mnOtvXa-HrXzhr_IPfyR1M9WpjHFyf5zitccFqTf5eNw_zRZj9AF101W78_zLIKbLQSD9K9lbPWOwN34eRppA5vLJE Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: a69f2b2876ed47459a8b960ff679c724 Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:22:51.360530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:22:51.362105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a69f2b2876ed47459a8b960ff679c724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:22:51.362105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:51.362105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: a69f2b2876ed47459a8b960ff679c724 Aug 30 01:22:51.362105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706439447 Aug 30 01:22:51.362105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeTestJSON-706439447-project Aug 30 01:22:51.362105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:22:51.362105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:22:51.362105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: d5bd0cb311db42d7882a4cf90b0d85e8 Aug 30 01:22:51.362105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeTestJSON-706439447-project Aug 30 01:22:51.362105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:22:51.362105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:22:51.362105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '6657e20f-b2a0-4f01-9dca-fd276792dc73'} Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:22:51.363083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. Aug 30 01:22:51.364468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:22:51.365578 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4ac0668f-18a3-4974-9857-7c1ec961a70e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] Returning 404 to user: Instance 6657e20f-b2a0-4f01-9dca-fd276792dc73 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:22:51.365578 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4ac0668f-18a3-4974-9857-7c1ec961a70e tempest-AttachVolumeTestJSON-706439447 tempest-AttachVolumeTestJSON-706439447-project] 10.222.0.44 "GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73" status: 404 len: 111 microversion: 2.1 time: 0.034394 Aug 30 01:22:51.365578 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 326/651] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:51 2022] GET /compute/v2.1/servers/6657e20f-b2a0-4f01-9dca-fd276792dc73 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:51.585672 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e352d254-cab3-4f0c-9b09-3505cc76849f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:51.586719 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e352d254-cab3-4f0c-9b09-3505cc76849f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:51.605643 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e352d254-cab3-4f0c-9b09-3505cc76849f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:51.606831 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e352d254-cab3-4f0c-9b09-3505cc76849f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:51.607489 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e352d254-cab3-4f0c-9b09-3505cc76849f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:51.608357 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e352d254-cab3-4f0c-9b09-3505cc76849f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:51.609666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e352d254-cab3-4f0c-9b09-3505cc76849f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:51.610391 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e352d254-cab3-4f0c-9b09-3505cc76849f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:51.637565 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:51.681893 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-017a7129-9016-4e39-b894-a3bcd6fc43d5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:51.682538 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-017a7129-9016-4e39-b894-a3bcd6fc43d5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:51.689861 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-017a7129-9016-4e39-b894-a3bcd6fc43d5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:51.690357 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-017a7129-9016-4e39-b894-a3bcd6fc43d5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:51.690800 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-017a7129-9016-4e39-b894-a3bcd6fc43d5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:51.691672 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-017a7129-9016-4e39-b894-a3bcd6fc43d5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:51.692178 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-017a7129-9016-4e39-b894-a3bcd6fc43d5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:51.692780 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-017a7129-9016-4e39-b894-a3bcd6fc43d5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:51.972039 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-017a7129-9016-4e39-b894-a3bcd6fc43d5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:51.986485 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-017a7129-9016-4e39-b894-a3bcd6fc43d5 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.313711 Aug 30 01:22:51.987769 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 327/652] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:51 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:52.042091 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e352d254-cab3-4f0c-9b09-3505cc76849f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:52.078566 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e352d254-cab3-4f0c-9b09-3505cc76849f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1265 microversion: 2.1 time: 0.502869 Aug 30 01:22:52.090349 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 326/653] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:51 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1265 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:52.853168 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e8c7fe7a-9cf9-4362-9147-6d1d9bdb4479 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:52.854097 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e8c7fe7a-9cf9-4362-9147-6d1d9bdb4479 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:52.861100 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e8c7fe7a-9cf9-4362-9147-6d1d9bdb4479 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:52.861588 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e8c7fe7a-9cf9-4362-9147-6d1d9bdb4479 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:52.862024 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e8c7fe7a-9cf9-4362-9147-6d1d9bdb4479 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:52.862724 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e8c7fe7a-9cf9-4362-9147-6d1d9bdb4479 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:52.863182 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e8c7fe7a-9cf9-4362-9147-6d1d9bdb4479 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:52.863607 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e8c7fe7a-9cf9-4362-9147-6d1d9bdb4479 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:52.889118 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e8c7fe7a-9cf9-4362-9147-6d1d9bdb4479 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/ips" status: 200 len: 153 microversion: 2.20 time: 0.039700 Aug 30 01:22:52.897094 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 328/654] 10.222.0.44 () {60 vars in 1289 bytes} [Tue Aug 30 01:22:52 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/ips => generated 153 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:22:53.008800 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-08df2ddd-08a1-4e96-9ab8-c013e4f138ec tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:53.016793 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-08df2ddd-08a1-4e96-9ab8-c013e4f138ec tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:53.023828 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-08df2ddd-08a1-4e96-9ab8-c013e4f138ec tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:53.024448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-08df2ddd-08a1-4e96-9ab8-c013e4f138ec tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:53.026577 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-08df2ddd-08a1-4e96-9ab8-c013e4f138ec tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:53.027328 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-08df2ddd-08a1-4e96-9ab8-c013e4f138ec tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:53.028727 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-08df2ddd-08a1-4e96-9ab8-c013e4f138ec tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:53.031337 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-08df2ddd-08a1-4e96-9ab8-c013e4f138ec tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:53.100099 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ea994a1d-dad7-4849-ad4c-71712d8c67e3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:53.100726 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ea994a1d-dad7-4849-ad4c-71712d8c67e3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:53.109123 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea994a1d-dad7-4849-ad4c-71712d8c67e3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:53.120413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea994a1d-dad7-4849-ad4c-71712d8c67e3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:53.120921 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea994a1d-dad7-4849-ad4c-71712d8c67e3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:53.121745 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea994a1d-dad7-4849-ad4c-71712d8c67e3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:53.122250 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea994a1d-dad7-4849-ad4c-71712d8c67e3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:53.125269 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea994a1d-dad7-4849-ad4c-71712d8c67e3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:53.445264 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ea994a1d-dad7-4849-ad4c-71712d8c67e3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:53.457646 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ea994a1d-dad7-4849-ad4c-71712d8c67e3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1265 microversion: 2.1 time: 0.361973 Aug 30 01:22:53.458661 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 329/655] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:53 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1265 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:53.463218 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-b398b6ed-af73-4d79-9f90-ec4fe1adc019 req-b6eb9170-bc76-45dd-878e-00e8e2d290f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68833d42-7eed-4b4c-b315-842b9c015dfd", "name": "network-vif-plugged", "status": "completed", "tag": "90cf8014-421d-45c2-8701-cc67f5ad29d1"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:53.476303 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b398b6ed-af73-4d79-9f90-ec4fe1adc019 req-b6eb9170-bc76-45dd-878e-00e8e2d290f5 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:53.477087 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b398b6ed-af73-4d79-9f90-ec4fe1adc019 req-b6eb9170-bc76-45dd-878e-00e8e2d290f5 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:53.477694 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b398b6ed-af73-4d79-9f90-ec4fe1adc019 req-b6eb9170-bc76-45dd-878e-00e8e2d290f5 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:53.492038 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-b398b6ed-af73-4d79-9f90-ec4fe1adc019 req-b6eb9170-bc76-45dd-878e-00e8e2d290f5 service nova] Creating event network-vif-plugged:90cf8014-421d-45c2-8701-cc67f5ad29d1 for instance 68833d42-7eed-4b4c-b315-842b9c015dfd on hv-cinder-81514 Aug 30 01:22:53.498664 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-b398b6ed-af73-4d79-9f90-ec4fe1adc019 req-b6eb9170-bc76-45dd-878e-00e8e2d290f5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038747 Aug 30 01:22:53.499549 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 330/656] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:53.694358 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-08df2ddd-08a1-4e96-9ab8-c013e4f138ec tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:53.705645 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-08df2ddd-08a1-4e96-9ab8-c013e4f138ec tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.699486 Aug 30 01:22:53.708860 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 327/657] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:53 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:54.479827 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5f299e14-18c3-4b6a-ac7f-3fc46997f72b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:54.480550 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5f299e14-18c3-4b6a-ac7f-3fc46997f72b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:54.487770 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f299e14-18c3-4b6a-ac7f-3fc46997f72b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:54.488481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f299e14-18c3-4b6a-ac7f-3fc46997f72b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:54.489066 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f299e14-18c3-4b6a-ac7f-3fc46997f72b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:54.489923 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f299e14-18c3-4b6a-ac7f-3fc46997f72b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:54.490364 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f299e14-18c3-4b6a-ac7f-3fc46997f72b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:54.490937 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f299e14-18c3-4b6a-ac7f-3fc46997f72b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:54.641223 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5f299e14-18c3-4b6a-ac7f-3fc46997f72b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:54.649047 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5f299e14-18c3-4b6a-ac7f-3fc46997f72b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1265 microversion: 2.1 time: 0.173945 Aug 30 01:22:54.649626 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 331/658] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:54 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:54.739492 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-eb3b4c16-6783-43fb-b4e2-d4df4d7bbad2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:54.740210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-eb3b4c16-6783-43fb-b4e2-d4df4d7bbad2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:54.743931 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:54.747553 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eb3b4c16-6783-43fb-b4e2-d4df4d7bbad2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:54.748135 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eb3b4c16-6783-43fb-b4e2-d4df4d7bbad2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:54.748696 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eb3b4c16-6783-43fb-b4e2-d4df4d7bbad2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:54.749572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eb3b4c16-6783-43fb-b4e2-d4df4d7bbad2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:54.750103 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eb3b4c16-6783-43fb-b4e2-d4df4d7bbad2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:54.750521 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eb3b4c16-6783-43fb-b4e2-d4df4d7bbad2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:54.961164 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-eb3b4c16-6783-43fb-b4e2-d4df4d7bbad2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:54.969168 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-eb3b4c16-6783-43fb-b4e2-d4df4d7bbad2 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1575 microversion: 2.1 time: 0.233478 Aug 30 01:22:54.970072 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 328/659] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:54 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1575 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:55.427065 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6568def6-6671-4a2f-aaa5-c0c084405835 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:55.428013 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6568def6-6671-4a2f-aaa5-c0c084405835 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:55.438689 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6568def6-6671-4a2f-aaa5-c0c084405835 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:55.439549 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6568def6-6671-4a2f-aaa5-c0c084405835 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:55.440342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6568def6-6671-4a2f-aaa5-c0c084405835 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:55.441341 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6568def6-6671-4a2f-aaa5-c0c084405835 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:55.442075 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6568def6-6671-4a2f-aaa5-c0c084405835 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:55.442769 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6568def6-6671-4a2f-aaa5-c0c084405835 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:55.508810 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-6568def6-6671-4a2f-aaa5-c0c084405835 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lazy-loading 'flavor' on Instance uuid 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:22:55.668981 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7e7177c5-4e9f-48bf-8997-bcc934d1b9f0 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:55.671415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7e7177c5-4e9f-48bf-8997-bcc934d1b9f0 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:55.685231 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7e7177c5-4e9f-48bf-8997-bcc934d1b9f0 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:55.685969 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7e7177c5-4e9f-48bf-8997-bcc934d1b9f0 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:55.686631 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7e7177c5-4e9f-48bf-8997-bcc934d1b9f0 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:55.687518 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7e7177c5-4e9f-48bf-8997-bcc934d1b9f0 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:55.688195 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7e7177c5-4e9f-48bf-8997-bcc934d1b9f0 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:55.688778 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7e7177c5-4e9f-48bf-8997-bcc934d1b9f0 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:55.804747 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6568def6-6671-4a2f-aaa5-c0c084405835 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "POST /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/action" status: 202 len: 0 microversion: 2.20 time: 0.381772 Aug 30 01:22:55.805926 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 332/660] 10.222.0.44 () {62 vars in 1319 bytes} [Tue Aug 30 01:22:55 2022] POST /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:22:55.820557 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fd4c4191-2eed-4aae-b779-dd71003c3068 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:55.821258 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fd4c4191-2eed-4aae-b779-dd71003c3068 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:55.857253 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fd4c4191-2eed-4aae-b779-dd71003c3068 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:55.857253 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fd4c4191-2eed-4aae-b779-dd71003c3068 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:55.857595 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fd4c4191-2eed-4aae-b779-dd71003c3068 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:55.859069 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fd4c4191-2eed-4aae-b779-dd71003c3068 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:55.859228 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fd4c4191-2eed-4aae-b779-dd71003c3068 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:55.859657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fd4c4191-2eed-4aae-b779-dd71003c3068 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:55.912729 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7e7177c5-4e9f-48bf-8997-bcc934d1b9f0 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:55.921519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7e7177c5-4e9f-48bf-8997-bcc934d1b9f0 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1265 microversion: 2.1 time: 0.255557 Aug 30 01:22:55.922295 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 329/661] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:55 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:55.990192 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a836a1a7-f2af-4ca5-95df-002b0b82a140 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:55.990793 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a836a1a7-f2af-4ca5-95df-002b0b82a140 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:55.997958 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a836a1a7-f2af-4ca5-95df-002b0b82a140 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:55.998526 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a836a1a7-f2af-4ca5-95df-002b0b82a140 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:55.999618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a836a1a7-f2af-4ca5-95df-002b0b82a140 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:56.000568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a836a1a7-f2af-4ca5-95df-002b0b82a140 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:56.004222 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a836a1a7-f2af-4ca5-95df-002b0b82a140 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:56.004222 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a836a1a7-f2af-4ca5-95df-002b0b82a140 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:56.057719 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fd4c4191-2eed-4aae-b779-dd71003c3068 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:56.066177 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fd4c4191-2eed-4aae-b779-dd71003c3068 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:56.067612 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fd4c4191-2eed-4aae-b779-dd71003c3068 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:56.068802 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fd4c4191-2eed-4aae-b779-dd71003c3068 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1724 microversion: 2.20 time: 0.256447 Aug 30 01:22:56.070005 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 333/662] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:55 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:22:56.164807 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a836a1a7-f2af-4ca5-95df-002b0b82a140 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:56.171951 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a836a1a7-f2af-4ca5-95df-002b0b82a140 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1562 microversion: 2.1 time: 0.185624 Aug 30 01:22:56.172852 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 330/663] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:55 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1562 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:56.943034 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ee710c8d-93f2-40f6-8901-e1e0f7cc3958 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:56.943682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ee710c8d-93f2-40f6-8901-e1e0f7cc3958 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:56.946368 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:56.953150 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee710c8d-93f2-40f6-8901-e1e0f7cc3958 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:56.953683 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee710c8d-93f2-40f6-8901-e1e0f7cc3958 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:56.954124 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee710c8d-93f2-40f6-8901-e1e0f7cc3958 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:56.954939 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee710c8d-93f2-40f6-8901-e1e0f7cc3958 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:56.955307 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee710c8d-93f2-40f6-8901-e1e0f7cc3958 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:56.955731 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee710c8d-93f2-40f6-8901-e1e0f7cc3958 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:57.094402 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7de62dab-8c60-43b7-922d-d3b480469570 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:57.095271 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7de62dab-8c60-43b7-922d-d3b480469570 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:57.097344 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ee710c8d-93f2-40f6-8901-e1e0f7cc3958 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:57.098384 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:57.099897 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=8 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:57.105107 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7de62dab-8c60-43b7-922d-d3b480469570 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:57.105702 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7de62dab-8c60-43b7-922d-d3b480469570 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:57.106282 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7de62dab-8c60-43b7-922d-d3b480469570 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:57.106964 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7de62dab-8c60-43b7-922d-d3b480469570 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:57.107139 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ee710c8d-93f2-40f6-8901-e1e0f7cc3958 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1265 microversion: 2.1 time: 0.168082 Aug 30 01:22:57.107551 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7de62dab-8c60-43b7-922d-d3b480469570 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:57.118310 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 334/664] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:56 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:57.118676 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7de62dab-8c60-43b7-922d-d3b480469570 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:57.250748 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7de62dab-8c60-43b7-922d-d3b480469570 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:57.260850 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7de62dab-8c60-43b7-922d-d3b480469570 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:57.262299 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7de62dab-8c60-43b7-922d-d3b480469570 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:57.263760 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7de62dab-8c60-43b7-922d-d3b480469570 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1724 microversion: 2.20 time: 0.174002 Aug 30 01:22:57.264905 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 331/665] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:57 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:22:58.133282 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-644873d2-83c9-45ff-a3e1-8491efe6cb0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:58.134539 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-644873d2-83c9-45ff-a3e1-8491efe6cb0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:58.142205 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-644873d2-83c9-45ff-a3e1-8491efe6cb0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:58.142891 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-644873d2-83c9-45ff-a3e1-8491efe6cb0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:58.143426 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-644873d2-83c9-45ff-a3e1-8491efe6cb0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:58.144379 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-644873d2-83c9-45ff-a3e1-8491efe6cb0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:58.144970 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-644873d2-83c9-45ff-a3e1-8491efe6cb0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:58.145531 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-644873d2-83c9-45ff-a3e1-8491efe6cb0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:58.289076 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-36420e21-c910-4fe0-81ca-739c30c9d33e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:58.290417 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-36420e21-c910-4fe0-81ca-739c30c9d33e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:58.297173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36420e21-c910-4fe0-81ca-739c30c9d33e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:58.297936 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36420e21-c910-4fe0-81ca-739c30c9d33e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:58.298535 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36420e21-c910-4fe0-81ca-739c30c9d33e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:58.299409 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36420e21-c910-4fe0-81ca-739c30c9d33e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:58.300195 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36420e21-c910-4fe0-81ca-739c30c9d33e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:58.300783 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36420e21-c910-4fe0-81ca-739c30c9d33e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:58.309943 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-644873d2-83c9-45ff-a3e1-8491efe6cb0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:58.319579 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-644873d2-83c9-45ff-a3e1-8491efe6cb0e tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1265 microversion: 2.1 time: 0.192230 Aug 30 01:22:58.320204 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 335/666] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:58 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:58.565556 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-36420e21-c910-4fe0-81ca-739c30c9d33e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:58.584964 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-36420e21-c910-4fe0-81ca-739c30c9d33e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:58.586390 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-36420e21-c910-4fe0-81ca-739c30c9d33e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:58.587611 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-36420e21-c910-4fe0-81ca-739c30c9d33e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1724 microversion: 2.20 time: 0.302558 Aug 30 01:22:58.588290 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 332/667] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:58 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:22:59.343404 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9bc80c9d-7dca-44f7-a42b-8f9591438b91 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:59.344229 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9bc80c9d-7dca-44f7-a42b-8f9591438b91 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:59.351476 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9bc80c9d-7dca-44f7-a42b-8f9591438b91 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:59.352207 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9bc80c9d-7dca-44f7-a42b-8f9591438b91 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:59.352702 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9bc80c9d-7dca-44f7-a42b-8f9591438b91 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:59.353406 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9bc80c9d-7dca-44f7-a42b-8f9591438b91 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:59.354060 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9bc80c9d-7dca-44f7-a42b-8f9591438b91 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:59.354428 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9bc80c9d-7dca-44f7-a42b-8f9591438b91 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:59.527358 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9bc80c9d-7dca-44f7-a42b-8f9591438b91 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:59.537919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9bc80c9d-7dca-44f7-a42b-8f9591438b91 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1265 microversion: 2.1 time: 0.199716 Aug 30 01:22:59.539169 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 336/668] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:59 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:59.611272 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-55c14354-fd84-4a88-a3e6-60f9cd4506bf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:59.612522 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-55c14354-fd84-4a88-a3e6-60f9cd4506bf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:59.619354 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55c14354-fd84-4a88-a3e6-60f9cd4506bf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:59.620063 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55c14354-fd84-4a88-a3e6-60f9cd4506bf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:59.620651 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55c14354-fd84-4a88-a3e6-60f9cd4506bf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:59.621541 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55c14354-fd84-4a88-a3e6-60f9cd4506bf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:59.622157 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55c14354-fd84-4a88-a3e6-60f9cd4506bf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:59.622739 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55c14354-fd84-4a88-a3e6-60f9cd4506bf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:59.812267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-55c14354-fd84-4a88-a3e6-60f9cd4506bf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:59.822227 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-55c14354-fd84-4a88-a3e6-60f9cd4506bf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:59.823898 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-55c14354-fd84-4a88-a3e6-60f9cd4506bf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:59.825582 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-55c14354-fd84-4a88-a3e6-60f9cd4506bf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1724 microversion: 2.20 time: 0.218513 Aug 30 01:22:59.826765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 333/669] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:22:59 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:00.561498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-87e598aa-e36c-4446-b18d-a4c72ed6c70a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:00.562382 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-87e598aa-e36c-4446-b18d-a4c72ed6c70a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:00.569670 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87e598aa-e36c-4446-b18d-a4c72ed6c70a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:00.570452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87e598aa-e36c-4446-b18d-a4c72ed6c70a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:00.570885 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87e598aa-e36c-4446-b18d-a4c72ed6c70a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:00.571615 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87e598aa-e36c-4446-b18d-a4c72ed6c70a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:00.572246 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87e598aa-e36c-4446-b18d-a4c72ed6c70a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:00.572675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87e598aa-e36c-4446-b18d-a4c72ed6c70a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:00.840568 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-87e598aa-e36c-4446-b18d-a4c72ed6c70a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:00.851381 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d55babb5-1c01-4220-b9d3-72f0ade4a7d9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:00.853515 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d55babb5-1c01-4220-b9d3-72f0ade4a7d9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:00.854360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-87e598aa-e36c-4446-b18d-a4c72ed6c70a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1265 microversion: 2.1 time: 0.297647 Aug 30 01:23:00.855367 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 337/670] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:00 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:00.863213 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d55babb5-1c01-4220-b9d3-72f0ade4a7d9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:00.863765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d55babb5-1c01-4220-b9d3-72f0ade4a7d9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:00.864235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d55babb5-1c01-4220-b9d3-72f0ade4a7d9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:00.865200 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d55babb5-1c01-4220-b9d3-72f0ade4a7d9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:00.865861 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d55babb5-1c01-4220-b9d3-72f0ade4a7d9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:00.866849 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d55babb5-1c01-4220-b9d3-72f0ade4a7d9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:01.044642 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d55babb5-1c01-4220-b9d3-72f0ade4a7d9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:01.056166 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d55babb5-1c01-4220-b9d3-72f0ade4a7d9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:01.063532 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d55babb5-1c01-4220-b9d3-72f0ade4a7d9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:01.065198 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d55babb5-1c01-4220-b9d3-72f0ade4a7d9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1724 microversion: 2.20 time: 0.219796 Aug 30 01:23:01.066416 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 334/671] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:00 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:01.233691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-31e50794-d9a8-4264-8947-887b14ccd82c req-35a76bc0-4f25-42d6-b697-a715d881ceba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0114fa80-59aa-458a-a4c3-6f49bdfa56bd", "name": "network-vif-plugged", "status": "completed", "tag": "a1ad209b-8fbb-43fc-9b1e-2133ae985606"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:01.243872 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-31e50794-d9a8-4264-8947-887b14ccd82c req-35a76bc0-4f25-42d6-b697-a715d881ceba service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:01.244704 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-31e50794-d9a8-4264-8947-887b14ccd82c req-35a76bc0-4f25-42d6-b697-a715d881ceba service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:01.245319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-31e50794-d9a8-4264-8947-887b14ccd82c req-35a76bc0-4f25-42d6-b697-a715d881ceba service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:01.270323 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-31e50794-d9a8-4264-8947-887b14ccd82c req-35a76bc0-4f25-42d6-b697-a715d881ceba service nova] Creating event network-vif-plugged:a1ad209b-8fbb-43fc-9b1e-2133ae985606 for instance 0114fa80-59aa-458a-a4c3-6f49bdfa56bd on hv-cinder-81514 Aug 30 01:23:01.277382 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-31e50794-d9a8-4264-8947-887b14ccd82c req-35a76bc0-4f25-42d6-b697-a715d881ceba service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046742 Aug 30 01:23:01.278454 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 338/672] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:23:01.876945 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9ca7ccf3-de56-43bf-b4e9-3a5b1d120332 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:01.878319 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9ca7ccf3-de56-43bf-b4e9-3a5b1d120332 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:01.885833 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ca7ccf3-de56-43bf-b4e9-3a5b1d120332 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:01.886543 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ca7ccf3-de56-43bf-b4e9-3a5b1d120332 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:01.887282 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ca7ccf3-de56-43bf-b4e9-3a5b1d120332 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:01.888211 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ca7ccf3-de56-43bf-b4e9-3a5b1d120332 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:01.888732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ca7ccf3-de56-43bf-b4e9-3a5b1d120332 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:01.889669 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ca7ccf3-de56-43bf-b4e9-3a5b1d120332 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:02.038250 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9ca7ccf3-de56-43bf-b4e9-3a5b1d120332 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:02.045940 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9ca7ccf3-de56-43bf-b4e9-3a5b1d120332 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1265 microversion: 2.1 time: 0.173248 Aug 30 01:23:02.047882 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 335/673] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:01 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:02.088708 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ca6c7791-ad4d-4052-bc19-0537709211ba tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:02.089312 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ca6c7791-ad4d-4052-bc19-0537709211ba tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:02.097122 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca6c7791-ad4d-4052-bc19-0537709211ba tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:02.097605 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca6c7791-ad4d-4052-bc19-0537709211ba tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:02.098039 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca6c7791-ad4d-4052-bc19-0537709211ba tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:02.098736 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca6c7791-ad4d-4052-bc19-0537709211ba tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:02.099214 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca6c7791-ad4d-4052-bc19-0537709211ba tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:02.099634 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca6c7791-ad4d-4052-bc19-0537709211ba tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:02.169993 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-65b316cc-e1a7-40fa-b5fa-a64a6c365811 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Action: 'create', calling method: .version_select at 0x7ff48ad0f940>, body: {"keypair": {"name": "tempest-keypair-1674744055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG+FiQHEIoYxer9u6dDCpzfbMmWtoczyYO+Focjda9/kIjopYhlyuNFrv6LwLfTkOm1LtvFlOpdXHIVp4Ljp32ug0rcc1pDghKmE6KFwZOupLN1O/3SfEh4BMOx1z3mTg=="}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:02.184920 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-65b316cc-e1a7-40fa-b5fa-a64a6c365811 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for project f5ddbf041c444253aea027770188fbaf. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:23:02.189410 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-65b316cc-e1a7-40fa-b5fa-a64a6c365811 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for user 4fe36a87392c40379ac160ebaa3cd84c and project f5ddbf041c444253aea027770188fbaf. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:23:02.212417 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-65b316cc-e1a7-40fa-b5fa-a64a6c365811 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.164866 Aug 30 01:23:02.213193 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 339/674] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Aug 30 01:23:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:23:02.257594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ca6c7791-ad4d-4052-bc19-0537709211ba tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:02.268474 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ca6c7791-ad4d-4052-bc19-0537709211ba tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:02.270530 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ca6c7791-ad4d-4052-bc19-0537709211ba tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:02.271948 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ca6c7791-ad4d-4052-bc19-0537709211ba tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1724 microversion: 2.20 time: 0.187513 Aug 30 01:23:02.284028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 336/675] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:02 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:03.068792 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2e52e9fd-eeaf-4cd1-9158-3c87449090f9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:03.069944 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2e52e9fd-eeaf-4cd1-9158-3c87449090f9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:03.077749 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2e52e9fd-eeaf-4cd1-9158-3c87449090f9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:03.078659 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2e52e9fd-eeaf-4cd1-9158-3c87449090f9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:03.079334 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2e52e9fd-eeaf-4cd1-9158-3c87449090f9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:03.080335 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2e52e9fd-eeaf-4cd1-9158-3c87449090f9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:03.082941 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2e52e9fd-eeaf-4cd1-9158-3c87449090f9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:03.083801 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2e52e9fd-eeaf-4cd1-9158-3c87449090f9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:03.287785 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2e52e9fd-eeaf-4cd1-9158-3c87449090f9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:03.298911 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5d64129c-cb6a-4d26-a32a-cd914ddd85c4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:03.300592 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5d64129c-cb6a-4d26-a32a-cd914ddd85c4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:03.302809 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2e52e9fd-eeaf-4cd1-9158-3c87449090f9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1265 microversion: 2.1 time: 0.237961 Aug 30 01:23:03.308609 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d64129c-cb6a-4d26-a32a-cd914ddd85c4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:03.309947 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d64129c-cb6a-4d26-a32a-cd914ddd85c4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:03.311457 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d64129c-cb6a-4d26-a32a-cd914ddd85c4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:03.312938 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d64129c-cb6a-4d26-a32a-cd914ddd85c4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:03.313789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d64129c-cb6a-4d26-a32a-cd914ddd85c4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:03.314466 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d64129c-cb6a-4d26-a32a-cd914ddd85c4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:03.317898 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 340/676] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:03 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:03.576698 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5d64129c-cb6a-4d26-a32a-cd914ddd85c4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:03.586441 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5d64129c-cb6a-4d26-a32a-cd914ddd85c4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:03.587896 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5d64129c-cb6a-4d26-a32a-cd914ddd85c4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:03.589109 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5d64129c-cb6a-4d26-a32a-cd914ddd85c4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1724 microversion: 2.20 time: 0.295295 Aug 30 01:23:03.589899 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 337/677] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:03 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:23:03.808117 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-487772998", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "129a2c61-8cde-4190-8f30-dda20a50e18f"}], "security_groups": [{"name": "tempest-securitygroup--769714651"}], "key_name": "tempest-keypair-1674744055", "user_data": "}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:03.923917 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] validate_networks() for [('129a2c61-8cde-4190-8f30-dda20a50e18f', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:23:04.326807 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b4c8e2ed-e0b2-4b4c-acd5-0cc34fef1538 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:04.327426 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b4c8e2ed-e0b2-4b4c-acd5-0cc34fef1538 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:04.337255 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4c8e2ed-e0b2-4b4c-acd5-0cc34fef1538 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:04.337841 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4c8e2ed-e0b2-4b4c-acd5-0cc34fef1538 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:04.338189 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4c8e2ed-e0b2-4b4c-acd5-0cc34fef1538 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:04.338931 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4c8e2ed-e0b2-4b4c-acd5-0cc34fef1538 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:04.339393 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4c8e2ed-e0b2-4b4c-acd5-0cc34fef1538 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:04.339819 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4c8e2ed-e0b2-4b4c-acd5-0cc34fef1538 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:04.432356 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:23:04.432874 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:23:04.433280 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:23:04.433694 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:23:04.434102 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:23:04.444645 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:04.445132 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:04.445570 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:04.446310 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:04.446764 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:04.447192 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:04.473931 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for project f5ddbf041c444253aea027770188fbaf. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:23:04.481549 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for user 4fe36a87392c40379ac160ebaa3cd84c and project f5ddbf041c444253aea027770188fbaf. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:23:04.498955 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:23:04.501490 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:23:04.506651 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b4c8e2ed-e0b2-4b4c-acd5-0cc34fef1538 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:04.516577 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b4c8e2ed-e0b2-4b4c-acd5-0cc34fef1538 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1453 microversion: 2.1 time: 0.193635 Aug 30 01:23:04.517835 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 338/678] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:04 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:23:04.539161 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-099dc372-bce4-4626-b83a-3fcb992629be tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:04.539856 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-099dc372-bce4-4626-b83a-3fcb992629be tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:04.549494 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-099dc372-bce4-4626-b83a-3fcb992629be tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:04.550472 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-099dc372-bce4-4626-b83a-3fcb992629be tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:04.551225 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-099dc372-bce4-4626-b83a-3fcb992629be tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:04.552273 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-099dc372-bce4-4626-b83a-3fcb992629be tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:04.553164 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-099dc372-bce4-4626-b83a-3fcb992629be tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:04.553776 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-099dc372-bce4-4626-b83a-3fcb992629be tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:04.570593 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [0e18a580-5336-4e05-9619-214d2f09ed9b] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 01:23:04.698601 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-099dc372-bce4-4626-b83a-3fcb992629be tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:04.707135 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-099dc372-bce4-4626-b83a-3fcb992629be tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1453 microversion: 2.1 time: 0.172960 Aug 30 01:23:04.708088 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 339/679] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:04 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:23:04.720272 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2a16ef61-f32e-4a7d-8e18-5e6d5a776ddb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:04.720960 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2a16ef61-f32e-4a7d-8e18-5e6d5a776ddb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:04.730598 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a16ef61-f32e-4a7d-8e18-5e6d5a776ddb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:04.731090 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a16ef61-f32e-4a7d-8e18-5e6d5a776ddb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:04.731529 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a16ef61-f32e-4a7d-8e18-5e6d5a776ddb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:04.733297 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a16ef61-f32e-4a7d-8e18-5e6d5a776ddb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:04.733604 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a16ef61-f32e-4a7d-8e18-5e6d5a776ddb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:04.734045 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a16ef61-f32e-4a7d-8e18-5e6d5a776ddb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:04.889404 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2a16ef61-f32e-4a7d-8e18-5e6d5a776ddb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:04.902872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2a16ef61-f32e-4a7d-8e18-5e6d5a776ddb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:04.904874 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2a16ef61-f32e-4a7d-8e18-5e6d5a776ddb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:04.906053 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2a16ef61-f32e-4a7d-8e18-5e6d5a776ddb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1724 microversion: 2.20 time: 0.190411 Aug 30 01:23:04.906613 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 340/680] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:04 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:05.580401 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO oslo.messaging._drivers.impl_rabbit [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [0e18a580-5336-4e05-9619-214d2f09ed9b] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 45030. Aug 30 01:23:05.585399 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c00fb50b-7252-4e31-b016-3692a2f638c5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.781565 Aug 30 01:23:05.592346 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 341/681] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:23:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:23:05.597678 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-81febe01-c7df-4c5b-bc71-f701cbc6f7ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:05.598940 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-81febe01-c7df-4c5b-bc71-f701cbc6f7ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:05.659803 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-81febe01-c7df-4c5b-bc71-f701cbc6f7ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:05.669179 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-81febe01-c7df-4c5b-bc71-f701cbc6f7ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1241 microversion: 2.1 time: 0.075505 Aug 30 01:23:05.670165 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 341/682] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:05 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:23:05.932811 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-04ca69d5-71ce-47b5-ab92-2ac0ba86c61a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:05.934112 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-04ca69d5-71ce-47b5-ab92-2ac0ba86c61a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:05.942553 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04ca69d5-71ce-47b5-ab92-2ac0ba86c61a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:05.943694 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04ca69d5-71ce-47b5-ab92-2ac0ba86c61a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:05.944282 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04ca69d5-71ce-47b5-ab92-2ac0ba86c61a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:05.945094 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04ca69d5-71ce-47b5-ab92-2ac0ba86c61a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:05.945620 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04ca69d5-71ce-47b5-ab92-2ac0ba86c61a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:05.946118 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04ca69d5-71ce-47b5-ab92-2ac0ba86c61a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:05.966651 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:06.201132 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-04ca69d5-71ce-47b5-ab92-2ac0ba86c61a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:06.212916 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-04ca69d5-71ce-47b5-ab92-2ac0ba86c61a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:06.214993 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-04ca69d5-71ce-47b5-ab92-2ac0ba86c61a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:06.216840 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-04ca69d5-71ce-47b5-ab92-2ac0ba86c61a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1724 microversion: 2.20 time: 0.288583 Aug 30 01:23:06.217555 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 342/683] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:05 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:06.517561 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-bb68b4fc-ed21-4737-9971-7327ff479d31 req-5ef8590b-cb4e-4cd9-acad-6aa4eccd0f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0114fa80-59aa-458a-a4c3-6f49bdfa56bd", "tag": "a1ad209b-8fbb-43fc-9b1e-2133ae985606"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:06.532179 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-bb68b4fc-ed21-4737-9971-7327ff479d31 req-5ef8590b-cb4e-4cd9-acad-6aa4eccd0f28 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:06.532961 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-bb68b4fc-ed21-4737-9971-7327ff479d31 req-5ef8590b-cb4e-4cd9-acad-6aa4eccd0f28 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:06.533597 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-bb68b4fc-ed21-4737-9971-7327ff479d31 req-5ef8590b-cb4e-4cd9-acad-6aa4eccd0f28 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:06.562489 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-bb68b4fc-ed21-4737-9971-7327ff479d31 req-5ef8590b-cb4e-4cd9-acad-6aa4eccd0f28 service nova] Creating event network-changed:a1ad209b-8fbb-43fc-9b1e-2133ae985606 for instance 0114fa80-59aa-458a-a4c3-6f49bdfa56bd on hv-cinder-81514 Aug 30 01:23:06.572766 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-bb68b4fc-ed21-4737-9971-7327ff479d31 req-5ef8590b-cb4e-4cd9-acad-6aa4eccd0f28 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060686 Aug 30 01:23:06.574426 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 342/684] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:23:06.689890 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-eb70c4d2-60f0-4760-8042-8bf7e2b18aaf tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:06.691445 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-eb70c4d2-60f0-4760-8042-8bf7e2b18aaf tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:06.698011 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eb70c4d2-60f0-4760-8042-8bf7e2b18aaf tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:06.698595 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eb70c4d2-60f0-4760-8042-8bf7e2b18aaf tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:06.699246 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eb70c4d2-60f0-4760-8042-8bf7e2b18aaf tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:06.700165 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eb70c4d2-60f0-4760-8042-8bf7e2b18aaf tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:06.701567 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eb70c4d2-60f0-4760-8042-8bf7e2b18aaf tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:06.702322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eb70c4d2-60f0-4760-8042-8bf7e2b18aaf tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:06.775380 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-eb70c4d2-60f0-4760-8042-8bf7e2b18aaf tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:06.784387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-eb70c4d2-60f0-4760-8042-8bf7e2b18aaf tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1293 microversion: 2.1 time: 0.098903 Aug 30 01:23:06.785119 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 343/685] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:06 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:07.244536 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9d432f34-09ae-402e-b48e-b8dc4f54f06e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:07.246733 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9d432f34-09ae-402e-b48e-b8dc4f54f06e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:07.261679 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9d432f34-09ae-402e-b48e-b8dc4f54f06e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:07.264585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9d432f34-09ae-402e-b48e-b8dc4f54f06e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:07.265152 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9d432f34-09ae-402e-b48e-b8dc4f54f06e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:07.265986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9d432f34-09ae-402e-b48e-b8dc4f54f06e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:07.266677 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9d432f34-09ae-402e-b48e-b8dc4f54f06e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:07.267207 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9d432f34-09ae-402e-b48e-b8dc4f54f06e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:07.522270 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9d432f34-09ae-402e-b48e-b8dc4f54f06e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:07.531237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9d432f34-09ae-402e-b48e-b8dc4f54f06e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:07.532747 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9d432f34-09ae-402e-b48e-b8dc4f54f06e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:07.533963 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9d432f34-09ae-402e-b48e-b8dc4f54f06e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1745 microversion: 2.20 time: 0.296060 Aug 30 01:23:07.534532 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 343/686] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:07 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1745 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:07.805901 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d6af4a6f-2567-4d2a-a0f1-a6def88f92a0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:07.806520 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d6af4a6f-2567-4d2a-a0f1-a6def88f92a0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:07.812985 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6af4a6f-2567-4d2a-a0f1-a6def88f92a0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:07.813470 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6af4a6f-2567-4d2a-a0f1-a6def88f92a0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:07.813905 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6af4a6f-2567-4d2a-a0f1-a6def88f92a0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:07.814597 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6af4a6f-2567-4d2a-a0f1-a6def88f92a0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:07.815046 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6af4a6f-2567-4d2a-a0f1-a6def88f92a0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:07.815545 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6af4a6f-2567-4d2a-a0f1-a6def88f92a0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:07.887900 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d6af4a6f-2567-4d2a-a0f1-a6def88f92a0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:07.896362 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d6af4a6f-2567-4d2a-a0f1-a6def88f92a0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1299 microversion: 2.1 time: 0.094239 Aug 30 01:23:07.896933 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 344/687] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:07 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:08.556839 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fc16843b-1209-4936-968a-dbd2d4cba82e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:08.557692 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fc16843b-1209-4936-968a-dbd2d4cba82e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:08.565376 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fc16843b-1209-4936-968a-dbd2d4cba82e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:08.566173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fc16843b-1209-4936-968a-dbd2d4cba82e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:08.566710 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fc16843b-1209-4936-968a-dbd2d4cba82e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:08.567539 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fc16843b-1209-4936-968a-dbd2d4cba82e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:08.568202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fc16843b-1209-4936-968a-dbd2d4cba82e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:08.568825 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fc16843b-1209-4936-968a-dbd2d4cba82e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:08.590174 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:08.723575 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fc16843b-1209-4936-968a-dbd2d4cba82e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:08.734197 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fc16843b-1209-4936-968a-dbd2d4cba82e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:08.735929 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fc16843b-1209-4936-968a-dbd2d4cba82e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:08.737482 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fc16843b-1209-4936-968a-dbd2d4cba82e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1745 microversion: 2.20 time: 0.184623 Aug 30 01:23:08.738248 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 344/688] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:08 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:08.924042 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c2180e10-1c2b-4fa3-90c6-e016d53fbd8e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:08.926221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c2180e10-1c2b-4fa3-90c6-e016d53fbd8e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:08.936762 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c2180e10-1c2b-4fa3-90c6-e016d53fbd8e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:08.937793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c2180e10-1c2b-4fa3-90c6-e016d53fbd8e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:08.938410 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c2180e10-1c2b-4fa3-90c6-e016d53fbd8e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:08.939378 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c2180e10-1c2b-4fa3-90c6-e016d53fbd8e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:08.940022 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c2180e10-1c2b-4fa3-90c6-e016d53fbd8e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:08.940604 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c2180e10-1c2b-4fa3-90c6-e016d53fbd8e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:09.184756 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c2180e10-1c2b-4fa3-90c6-e016d53fbd8e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:09.195690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-b8cebc92-4405-4abd-8fba-1406ac57f524 req-39ae9ba0-84f8-4e30-8209-0a9207f96d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1", "tag": "adf859bc-f00d-4d63-92fe-ba1e7b8709cd"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:09.203715 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c2180e10-1c2b-4fa3-90c6-e016d53fbd8e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1366 microversion: 2.1 time: 0.289533 Aug 30 01:23:09.224952 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 345/689] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:08 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:09.228030 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b8cebc92-4405-4abd-8fba-1406ac57f524 req-39ae9ba0-84f8-4e30-8209-0a9207f96d6c service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:09.228694 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b8cebc92-4405-4abd-8fba-1406ac57f524 req-39ae9ba0-84f8-4e30-8209-0a9207f96d6c service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:09.229510 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b8cebc92-4405-4abd-8fba-1406ac57f524 req-39ae9ba0-84f8-4e30-8209-0a9207f96d6c service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:09.243075 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-b8cebc92-4405-4abd-8fba-1406ac57f524 req-39ae9ba0-84f8-4e30-8209-0a9207f96d6c service nova] Creating event network-changed:adf859bc-f00d-4d63-92fe-ba1e7b8709cd for instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 on hv-cinder-81514 Aug 30 01:23:09.268326 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-b8cebc92-4405-4abd-8fba-1406ac57f524 req-39ae9ba0-84f8-4e30-8209-0a9207f96d6c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076046 Aug 30 01:23:09.268991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 345/690] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:23:09.761706 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4d1ebd4a-704a-43c4-babf-1d983b3362f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:09.762480 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4d1ebd4a-704a-43c4-babf-1d983b3362f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:09.771358 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d1ebd4a-704a-43c4-babf-1d983b3362f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:09.772254 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d1ebd4a-704a-43c4-babf-1d983b3362f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:09.772914 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d1ebd4a-704a-43c4-babf-1d983b3362f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:09.774488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d1ebd4a-704a-43c4-babf-1d983b3362f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:09.775321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d1ebd4a-704a-43c4-babf-1d983b3362f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:09.775967 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d1ebd4a-704a-43c4-babf-1d983b3362f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:09.968723 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4d1ebd4a-704a-43c4-babf-1d983b3362f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:09.978153 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4d1ebd4a-704a-43c4-babf-1d983b3362f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:09.980985 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4d1ebd4a-704a-43c4-babf-1d983b3362f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:09.983020 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4d1ebd4a-704a-43c4-babf-1d983b3362f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1740 microversion: 2.20 time: 0.225405 Aug 30 01:23:09.995956 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 346/691] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:09 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:10.234283 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ebb75d2f-c3b7-488f-9c7d-bed959f4b598 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:10.234897 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ebb75d2f-c3b7-488f-9c7d-bed959f4b598 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:10.243584 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebb75d2f-c3b7-488f-9c7d-bed959f4b598 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:10.244118 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebb75d2f-c3b7-488f-9c7d-bed959f4b598 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:10.244557 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebb75d2f-c3b7-488f-9c7d-bed959f4b598 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:10.245471 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebb75d2f-c3b7-488f-9c7d-bed959f4b598 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:10.246096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebb75d2f-c3b7-488f-9c7d-bed959f4b598 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:10.246686 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebb75d2f-c3b7-488f-9c7d-bed959f4b598 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:10.427268 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ebb75d2f-c3b7-488f-9c7d-bed959f4b598 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:10.435910 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ebb75d2f-c3b7-488f-9c7d-bed959f4b598 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1366 microversion: 2.1 time: 0.206238 Aug 30 01:23:10.436520 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 346/692] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:10 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:11.008564 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f34783c4-4e54-47e7-8e85-5c5c5aeda888 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:11.009092 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f34783c4-4e54-47e7-8e85-5c5c5aeda888 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:11.022122 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f34783c4-4e54-47e7-8e85-5c5c5aeda888 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:11.022987 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f34783c4-4e54-47e7-8e85-5c5c5aeda888 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:11.023613 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f34783c4-4e54-47e7-8e85-5c5c5aeda888 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:11.024541 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f34783c4-4e54-47e7-8e85-5c5c5aeda888 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:11.025159 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f34783c4-4e54-47e7-8e85-5c5c5aeda888 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:11.025745 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f34783c4-4e54-47e7-8e85-5c5c5aeda888 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:11.344433 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-3ada3948-16ab-41bc-9081-9f2b9b760930 req-8037c4e3-782c-49f4-aca5-239654581248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa5b2d0-a841-4330-998e-ecb58b4ef9f3", "name": "network-vif-plugged", "status": "completed", "tag": "4ccc2f03-e4d5-41df-ae6e-d6c35f2a9ef3"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:11.372947 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-3ada3948-16ab-41bc-9081-9f2b9b760930 req-8037c4e3-782c-49f4-aca5-239654581248 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:11.373563 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-3ada3948-16ab-41bc-9081-9f2b9b760930 req-8037c4e3-782c-49f4-aca5-239654581248 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:11.373987 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-3ada3948-16ab-41bc-9081-9f2b9b760930 req-8037c4e3-782c-49f4-aca5-239654581248 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:11.402687 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-3ada3948-16ab-41bc-9081-9f2b9b760930 req-8037c4e3-782c-49f4-aca5-239654581248 service nova] Creating event network-vif-plugged:4ccc2f03-e4d5-41df-ae6e-d6c35f2a9ef3 for instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 on hv-cinder-81514 Aug 30 01:23:11.404823 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f34783c4-4e54-47e7-8e85-5c5c5aeda888 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:11.409859 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-3ada3948-16ab-41bc-9081-9f2b9b760930 req-8037c4e3-782c-49f4-aca5-239654581248 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068899 Aug 30 01:23:11.414506 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 347/693] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:23:11.417080 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f34783c4-4e54-47e7-8e85-5c5c5aeda888 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:11.420853 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f34783c4-4e54-47e7-8e85-5c5c5aeda888 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:11.422460 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f34783c4-4e54-47e7-8e85-5c5c5aeda888 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1740 microversion: 2.20 time: 0.417929 Aug 30 01:23:11.423588 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 347/694] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:11 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1740 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:11.459158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e2b5e50e-d384-44ab-a8ca-e1b685c8a5a8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:11.459950 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e2b5e50e-d384-44ab-a8ca-e1b685c8a5a8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:11.467144 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e2b5e50e-d384-44ab-a8ca-e1b685c8a5a8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:11.467723 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e2b5e50e-d384-44ab-a8ca-e1b685c8a5a8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:11.468245 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e2b5e50e-d384-44ab-a8ca-e1b685c8a5a8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:11.469013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e2b5e50e-d384-44ab-a8ca-e1b685c8a5a8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:11.469526 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e2b5e50e-d384-44ab-a8ca-e1b685c8a5a8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:11.470013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e2b5e50e-d384-44ab-a8ca-e1b685c8a5a8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:11.655519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e2b5e50e-d384-44ab-a8ca-e1b685c8a5a8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:11.664772 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e2b5e50e-d384-44ab-a8ca-e1b685c8a5a8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1366 microversion: 2.1 time: 0.209735 Aug 30 01:23:11.665969 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 348/695] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:11 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:12.446353 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2902e3c0-7e4a-44e0-9f51-0a0727c695f6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:12.447919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2902e3c0-7e4a-44e0-9f51-0a0727c695f6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:12.456289 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2902e3c0-7e4a-44e0-9f51-0a0727c695f6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:12.456777 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2902e3c0-7e4a-44e0-9f51-0a0727c695f6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:12.457217 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2902e3c0-7e4a-44e0-9f51-0a0727c695f6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:12.457915 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2902e3c0-7e4a-44e0-9f51-0a0727c695f6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:12.458369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2902e3c0-7e4a-44e0-9f51-0a0727c695f6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:12.458795 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2902e3c0-7e4a-44e0-9f51-0a0727c695f6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:12.601686 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2902e3c0-7e4a-44e0-9f51-0a0727c695f6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:12.610385 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2902e3c0-7e4a-44e0-9f51-0a0727c695f6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:12.611956 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2902e3c0-7e4a-44e0-9f51-0a0727c695f6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:12.613291 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2902e3c0-7e4a-44e0-9f51-0a0727c695f6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1740 microversion: 2.20 time: 0.170855 Aug 30 01:23:12.614216 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 348/696] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:12 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:12.692933 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d37ac128-c90c-4a1e-9f62-5fb5f2d87e37 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:12.694393 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d37ac128-c90c-4a1e-9f62-5fb5f2d87e37 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:12.702035 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d37ac128-c90c-4a1e-9f62-5fb5f2d87e37 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:12.702593 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d37ac128-c90c-4a1e-9f62-5fb5f2d87e37 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:12.703115 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d37ac128-c90c-4a1e-9f62-5fb5f2d87e37 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:12.703878 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d37ac128-c90c-4a1e-9f62-5fb5f2d87e37 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:12.704704 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d37ac128-c90c-4a1e-9f62-5fb5f2d87e37 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:12.705348 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d37ac128-c90c-4a1e-9f62-5fb5f2d87e37 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:12.861169 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d37ac128-c90c-4a1e-9f62-5fb5f2d87e37 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:12.870083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d37ac128-c90c-4a1e-9f62-5fb5f2d87e37 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1366 microversion: 2.1 time: 0.187106 Aug 30 01:23:12.870777 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 349/697] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:12 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:13.640414 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e800d6b9-0a7e-43b8-9552-3f79239777e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:13.641673 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e800d6b9-0a7e-43b8-9552-3f79239777e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:13.648349 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e800d6b9-0a7e-43b8-9552-3f79239777e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:13.649453 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e800d6b9-0a7e-43b8-9552-3f79239777e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:13.650105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e800d6b9-0a7e-43b8-9552-3f79239777e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:13.651052 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e800d6b9-0a7e-43b8-9552-3f79239777e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:13.651705 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e800d6b9-0a7e-43b8-9552-3f79239777e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:13.652322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e800d6b9-0a7e-43b8-9552-3f79239777e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:13.816956 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e800d6b9-0a7e-43b8-9552-3f79239777e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:13.825970 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e800d6b9-0a7e-43b8-9552-3f79239777e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:13.827552 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e800d6b9-0a7e-43b8-9552-3f79239777e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:13.828768 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e800d6b9-0a7e-43b8-9552-3f79239777e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1740 microversion: 2.20 time: 0.196037 Aug 30 01:23:13.839519 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 349/698] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:13 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:13.892520 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a25120f5-33f0-4680-a072-cfe8da39d64f tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:13.893189 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a25120f5-33f0-4680-a072-cfe8da39d64f tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:13.911190 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a25120f5-33f0-4680-a072-cfe8da39d64f tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:13.911974 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a25120f5-33f0-4680-a072-cfe8da39d64f tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:13.912583 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a25120f5-33f0-4680-a072-cfe8da39d64f tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:13.913437 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a25120f5-33f0-4680-a072-cfe8da39d64f tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:13.914038 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a25120f5-33f0-4680-a072-cfe8da39d64f tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:13.914606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a25120f5-33f0-4680-a072-cfe8da39d64f tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:14.072245 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a25120f5-33f0-4680-a072-cfe8da39d64f tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:14.083964 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a25120f5-33f0-4680-a072-cfe8da39d64f tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1366 microversion: 2.1 time: 0.196819 Aug 30 01:23:14.085205 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 350/699] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:13 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:14.853710 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4bcc5b70-34cc-4c6b-9104-72459509b23a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:14.854834 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4bcc5b70-34cc-4c6b-9104-72459509b23a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:14.857534 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:14.859043 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=10 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:14.867548 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4bcc5b70-34cc-4c6b-9104-72459509b23a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:14.868247 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4bcc5b70-34cc-4c6b-9104-72459509b23a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:14.868793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4bcc5b70-34cc-4c6b-9104-72459509b23a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:14.869569 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4bcc5b70-34cc-4c6b-9104-72459509b23a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:14.870096 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4bcc5b70-34cc-4c6b-9104-72459509b23a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:14.870592 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4bcc5b70-34cc-4c6b-9104-72459509b23a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:15.024922 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4bcc5b70-34cc-4c6b-9104-72459509b23a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:15.034407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4bcc5b70-34cc-4c6b-9104-72459509b23a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:15.035939 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4bcc5b70-34cc-4c6b-9104-72459509b23a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:15.037244 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4bcc5b70-34cc-4c6b-9104-72459509b23a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1740 microversion: 2.20 time: 0.187634 Aug 30 01:23:15.037886 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 350/700] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:14 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:23:15.106529 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-62b82c22-58e7-42cb-afb8-eb00409258f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:15.107332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-62b82c22-58e7-42cb-afb8-eb00409258f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:15.114636 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62b82c22-58e7-42cb-afb8-eb00409258f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:15.115659 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62b82c22-58e7-42cb-afb8-eb00409258f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:15.116304 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62b82c22-58e7-42cb-afb8-eb00409258f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:15.117228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62b82c22-58e7-42cb-afb8-eb00409258f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:15.117854 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62b82c22-58e7-42cb-afb8-eb00409258f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:15.118316 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62b82c22-58e7-42cb-afb8-eb00409258f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:15.285999 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-62b82c22-58e7-42cb-afb8-eb00409258f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:15.300216 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-62b82c22-58e7-42cb-afb8-eb00409258f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1366 microversion: 2.1 time: 0.197541 Aug 30 01:23:15.301434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 351/701] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:15 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:15.314640 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-fb104e0d-ae2d-4834-a843-2ab4c6aa695b req-f85c5bfc-c3b9-43af-880e-5d7b720cac51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1", "name": "network-vif-plugged", "status": "completed", "tag": "adf859bc-f00d-4d63-92fe-ba1e7b8709cd"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:15.331787 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-fb104e0d-ae2d-4834-a843-2ab4c6aa695b req-f85c5bfc-c3b9-43af-880e-5d7b720cac51 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:15.332283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-fb104e0d-ae2d-4834-a843-2ab4c6aa695b req-f85c5bfc-c3b9-43af-880e-5d7b720cac51 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:15.332704 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-fb104e0d-ae2d-4834-a843-2ab4c6aa695b req-f85c5bfc-c3b9-43af-880e-5d7b720cac51 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:15.347791 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-fb104e0d-ae2d-4834-a843-2ab4c6aa695b req-f85c5bfc-c3b9-43af-880e-5d7b720cac51 service nova] Creating event network-vif-plugged:adf859bc-f00d-4d63-92fe-ba1e7b8709cd for instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 on hv-cinder-81514 Aug 30 01:23:15.353145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-fb104e0d-ae2d-4834-a843-2ab4c6aa695b req-f85c5bfc-c3b9-43af-880e-5d7b720cac51 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055094 Aug 30 01:23:15.354054 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 351/702] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:23:16.061225 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5eb1d8d8-a48c-4348-aac2-256b5d00c3b2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:16.061839 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5eb1d8d8-a48c-4348-aac2-256b5d00c3b2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:16.063826 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:16.072059 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5eb1d8d8-a48c-4348-aac2-256b5d00c3b2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:16.072588 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5eb1d8d8-a48c-4348-aac2-256b5d00c3b2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:16.073027 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5eb1d8d8-a48c-4348-aac2-256b5d00c3b2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:16.073748 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5eb1d8d8-a48c-4348-aac2-256b5d00c3b2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:16.074201 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5eb1d8d8-a48c-4348-aac2-256b5d00c3b2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:16.074678 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5eb1d8d8-a48c-4348-aac2-256b5d00c3b2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:16.225001 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5eb1d8d8-a48c-4348-aac2-256b5d00c3b2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:16.237077 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5eb1d8d8-a48c-4348-aac2-256b5d00c3b2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:16.238564 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5eb1d8d8-a48c-4348-aac2-256b5d00c3b2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:16.239725 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5eb1d8d8-a48c-4348-aac2-256b5d00c3b2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1740 microversion: 2.20 time: 0.182615 Aug 30 01:23:16.240558 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 352/703] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:16 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:16.323938 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-09f01f17-b040-46f1-a513-d0b8719d6e10 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:16.325338 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-09f01f17-b040-46f1-a513-d0b8719d6e10 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:16.331644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09f01f17-b040-46f1-a513-d0b8719d6e10 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:16.332177 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09f01f17-b040-46f1-a513-d0b8719d6e10 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:16.332649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09f01f17-b040-46f1-a513-d0b8719d6e10 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:16.333368 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09f01f17-b040-46f1-a513-d0b8719d6e10 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:16.333828 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09f01f17-b040-46f1-a513-d0b8719d6e10 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:16.334260 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09f01f17-b040-46f1-a513-d0b8719d6e10 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:16.484822 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-09f01f17-b040-46f1-a513-d0b8719d6e10 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:16.495383 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-09f01f17-b040-46f1-a513-d0b8719d6e10 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1366 microversion: 2.1 time: 0.175856 Aug 30 01:23:16.508351 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 352/704] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:16 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:17.263948 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-349aefb4-01bb-492e-80c2-bf50d6a6a8a9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:17.264562 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-349aefb4-01bb-492e-80c2-bf50d6a6a8a9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:17.273226 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-349aefb4-01bb-492e-80c2-bf50d6a6a8a9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:17.273721 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-349aefb4-01bb-492e-80c2-bf50d6a6a8a9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:17.274159 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-349aefb4-01bb-492e-80c2-bf50d6a6a8a9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:17.274879 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-349aefb4-01bb-492e-80c2-bf50d6a6a8a9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:17.275507 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-349aefb4-01bb-492e-80c2-bf50d6a6a8a9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:17.275940 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-349aefb4-01bb-492e-80c2-bf50d6a6a8a9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:17.434958 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-349aefb4-01bb-492e-80c2-bf50d6a6a8a9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:17.443737 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-349aefb4-01bb-492e-80c2-bf50d6a6a8a9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:17.445215 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-349aefb4-01bb-492e-80c2-bf50d6a6a8a9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:17.446425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-349aefb4-01bb-492e-80c2-bf50d6a6a8a9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1740 microversion: 2.20 time: 0.186501 Aug 30 01:23:17.447235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 353/705] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:17 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:17.518017 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8883f14c-d3d8-4493-beff-a706002ecc16 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:17.518600 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8883f14c-d3d8-4493-beff-a706002ecc16 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:17.527142 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883f14c-d3d8-4493-beff-a706002ecc16 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:17.528188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883f14c-d3d8-4493-beff-a706002ecc16 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:17.528623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883f14c-d3d8-4493-beff-a706002ecc16 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:17.529515 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883f14c-d3d8-4493-beff-a706002ecc16 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:17.530115 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883f14c-d3d8-4493-beff-a706002ecc16 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:17.530689 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883f14c-d3d8-4493-beff-a706002ecc16 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:17.682841 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8883f14c-d3d8-4493-beff-a706002ecc16 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:17.700646 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8883f14c-d3d8-4493-beff-a706002ecc16 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1556 microversion: 2.1 time: 0.186941 Aug 30 01:23:17.701391 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 353/706] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:17 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:17.725684 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d641e0e4-cb87-45d9-9c72-3f74f08c48d8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:17.726573 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d641e0e4-cb87-45d9-9c72-3f74f08c48d8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:17.732852 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d641e0e4-cb87-45d9-9c72-3f74f08c48d8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:17.733623 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d641e0e4-cb87-45d9-9c72-3f74f08c48d8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:17.734131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d641e0e4-cb87-45d9-9c72-3f74f08c48d8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:17.734909 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d641e0e4-cb87-45d9-9c72-3f74f08c48d8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:17.735425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d641e0e4-cb87-45d9-9c72-3f74f08c48d8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:17.735944 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d641e0e4-cb87-45d9-9c72-3f74f08c48d8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:17.824155 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d641e0e4-cb87-45d9-9c72-3f74f08c48d8 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102395 Aug 30 01:23:17.825848 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 354/707] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Aug 30 01:23:17 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:23:18.470171 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0a2c40b6-ec2f-4a0a-9200-f6cf84a9e761 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:18.470780 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0a2c40b6-ec2f-4a0a-9200-f6cf84a9e761 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:18.477106 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0a2c40b6-ec2f-4a0a-9200-f6cf84a9e761 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:18.477595 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0a2c40b6-ec2f-4a0a-9200-f6cf84a9e761 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:18.478028 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0a2c40b6-ec2f-4a0a-9200-f6cf84a9e761 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:18.478714 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0a2c40b6-ec2f-4a0a-9200-f6cf84a9e761 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:18.479159 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0a2c40b6-ec2f-4a0a-9200-f6cf84a9e761 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:18.479572 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0a2c40b6-ec2f-4a0a-9200-f6cf84a9e761 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:18.663751 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0a2c40b6-ec2f-4a0a-9200-f6cf84a9e761 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:18.672705 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0a2c40b6-ec2f-4a0a-9200-f6cf84a9e761 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:18.674037 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0a2c40b6-ec2f-4a0a-9200-f6cf84a9e761 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:18.675204 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0a2c40b6-ec2f-4a0a-9200-f6cf84a9e761 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1740 microversion: 2.20 time: 0.209309 Aug 30 01:23:18.675755 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 354/708] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:18 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:18.921375 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-d64ea0be-6cca-4108-ad53-803279ddc608 req-447f83fa-78b6-4263-91b3-b339fee20a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1", "tag": "adf859bc-f00d-4d63-92fe-ba1e7b8709cd"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:18.931937 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-d64ea0be-6cca-4108-ad53-803279ddc608 req-447f83fa-78b6-4263-91b3-b339fee20a38 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:18.932445 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-d64ea0be-6cca-4108-ad53-803279ddc608 req-447f83fa-78b6-4263-91b3-b339fee20a38 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:18.933119 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-d64ea0be-6cca-4108-ad53-803279ddc608 req-447f83fa-78b6-4263-91b3-b339fee20a38 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:18.945293 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-d64ea0be-6cca-4108-ad53-803279ddc608 req-447f83fa-78b6-4263-91b3-b339fee20a38 service nova] Creating event network-changed:adf859bc-f00d-4d63-92fe-ba1e7b8709cd for instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 on hv-cinder-81514 Aug 30 01:23:18.951148 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-d64ea0be-6cca-4108-ad53-803279ddc608 req-447f83fa-78b6-4263-91b3-b339fee20a38 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034594 Aug 30 01:23:18.952055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 355/709] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:23:19.700465 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-692074d9-7b1b-4d6b-a0ef-fa9be3d02f49 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:19.701942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-692074d9-7b1b-4d6b-a0ef-fa9be3d02f49 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:19.711048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-692074d9-7b1b-4d6b-a0ef-fa9be3d02f49 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:19.714380 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-692074d9-7b1b-4d6b-a0ef-fa9be3d02f49 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:19.715227 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-692074d9-7b1b-4d6b-a0ef-fa9be3d02f49 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:19.716425 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-692074d9-7b1b-4d6b-a0ef-fa9be3d02f49 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:19.717241 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-692074d9-7b1b-4d6b-a0ef-fa9be3d02f49 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:19.717906 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-692074d9-7b1b-4d6b-a0ef-fa9be3d02f49 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:19.897498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-692074d9-7b1b-4d6b-a0ef-fa9be3d02f49 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:19.906104 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-692074d9-7b1b-4d6b-a0ef-fa9be3d02f49 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:19.907657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-692074d9-7b1b-4d6b-a0ef-fa9be3d02f49 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:19.908852 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-692074d9-7b1b-4d6b-a0ef-fa9be3d02f49 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1722 microversion: 2.20 time: 0.214043 Aug 30 01:23:19.909415 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 355/710] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:19 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:20.933393 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-19424c6d-067e-4e23-b4e3-f00204fc4ca7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:20.934609 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-19424c6d-067e-4e23-b4e3-f00204fc4ca7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:20.940484 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-19424c6d-067e-4e23-b4e3-f00204fc4ca7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:20.940963 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-19424c6d-067e-4e23-b4e3-f00204fc4ca7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:20.941396 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-19424c6d-067e-4e23-b4e3-f00204fc4ca7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:20.942088 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-19424c6d-067e-4e23-b4e3-f00204fc4ca7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:20.942539 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-19424c6d-067e-4e23-b4e3-f00204fc4ca7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:20.942956 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-19424c6d-067e-4e23-b4e3-f00204fc4ca7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:21.085384 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-19424c6d-067e-4e23-b4e3-f00204fc4ca7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:21.094681 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-19424c6d-067e-4e23-b4e3-f00204fc4ca7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:21.096152 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-19424c6d-067e-4e23-b4e3-f00204fc4ca7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:21.097317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-19424c6d-067e-4e23-b4e3-f00204fc4ca7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1722 microversion: 2.20 time: 0.168801 Aug 30 01:23:21.097877 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 356/711] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:20 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:22.120271 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f0866893-9096-4468-8f91-706b350fdb9c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:22.120904 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f0866893-9096-4468-8f91-706b350fdb9c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:22.127384 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f0866893-9096-4468-8f91-706b350fdb9c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:22.127868 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f0866893-9096-4468-8f91-706b350fdb9c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:22.128343 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f0866893-9096-4468-8f91-706b350fdb9c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:22.129038 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f0866893-9096-4468-8f91-706b350fdb9c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:22.129492 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f0866893-9096-4468-8f91-706b350fdb9c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:22.129915 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f0866893-9096-4468-8f91-706b350fdb9c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:22.264339 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f0866893-9096-4468-8f91-706b350fdb9c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:22.273548 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f0866893-9096-4468-8f91-706b350fdb9c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:22.274996 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f0866893-9096-4468-8f91-706b350fdb9c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:22.276228 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f0866893-9096-4468-8f91-706b350fdb9c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1725 microversion: 2.20 time: 0.159923 Aug 30 01:23:22.276750 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 356/712] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:22 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:22.298975 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f976f010-5ff2-4ba4-8f89-97fc2e2fc44e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9b9985b-0fc1-45b1-9470-625fc9e1084f"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:22.301471 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f976f010-5ff2-4ba4-8f89-97fc2e2fc44e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:22.308238 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f976f010-5ff2-4ba4-8f89-97fc2e2fc44e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:22.308752 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f976f010-5ff2-4ba4-8f89-97fc2e2fc44e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:22.309179 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f976f010-5ff2-4ba4-8f89-97fc2e2fc44e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:22.309895 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f976f010-5ff2-4ba4-8f89-97fc2e2fc44e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:22.310550 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f976f010-5ff2-4ba4-8f89-97fc2e2fc44e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:22.310970 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f976f010-5ff2-4ba4-8f89-97fc2e2fc44e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:22.597746 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f976f010-5ff2-4ba4-8f89-97fc2e2fc44e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "POST /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302587 Aug 30 01:23:22.598517 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 357/713] 10.222.0.44 () {62 vars in 1364 bytes} [Tue Aug 30 01:23:22 2022] POST /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:23:22.721358 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3ace5896-e5a7-4527-ba12-f512b4a59781 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:22.722081 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3ace5896-e5a7-4527-ba12-f512b4a59781 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:22.728129 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ace5896-e5a7-4527-ba12-f512b4a59781 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:22.728617 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ace5896-e5a7-4527-ba12-f512b4a59781 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:22.729138 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ace5896-e5a7-4527-ba12-f512b4a59781 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:22.729743 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ace5896-e5a7-4527-ba12-f512b4a59781 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:22.730229 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ace5896-e5a7-4527-ba12-f512b4a59781 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:22.730771 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ace5896-e5a7-4527-ba12-f512b4a59781 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:22.774390 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3ace5896-e5a7-4527-ba12-f512b4a59781 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120706) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 01:23:22.843028 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3ace5896-e5a7-4527-ba12-f512b4a59781 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "POST /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/action" status: 202 len: 0 microversion: 2.20 time: 0.125608 Aug 30 01:23:22.843614 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 357/714] 10.222.0.44 () {62 vars in 1319 bytes} [Tue Aug 30 01:23:22 2022] POST /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:23:22.851769 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-13555df2-79a6-4d5f-9c36-00bb01904d8e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:22.852480 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-13555df2-79a6-4d5f-9c36-00bb01904d8e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:22.859840 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13555df2-79a6-4d5f-9c36-00bb01904d8e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:22.860362 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13555df2-79a6-4d5f-9c36-00bb01904d8e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:22.860804 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13555df2-79a6-4d5f-9c36-00bb01904d8e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:22.861515 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13555df2-79a6-4d5f-9c36-00bb01904d8e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:22.861955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13555df2-79a6-4d5f-9c36-00bb01904d8e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:22.863013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13555df2-79a6-4d5f-9c36-00bb01904d8e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:23.001289 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-13555df2-79a6-4d5f-9c36-00bb01904d8e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:23.009705 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-13555df2-79a6-4d5f-9c36-00bb01904d8e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:23.011128 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-13555df2-79a6-4d5f-9c36-00bb01904d8e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:23.012393 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-13555df2-79a6-4d5f-9c36-00bb01904d8e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1751 microversion: 2.20 time: 0.164618 Aug 30 01:23:23.013022 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 358/715] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:22 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:23.349086 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-310a47be-0830-453c-b671-ffcb2ee5a33a req-b5f56ca0-43e1-4260-a4ab-54ae430e5aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa5b2d0-a841-4330-998e-ecb58b4ef9f3", "name": "network-vif-unplugged", "status": "completed", "tag": "4ccc2f03-e4d5-41df-ae6e-d6c35f2a9ef3"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:23.362069 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-310a47be-0830-453c-b671-ffcb2ee5a33a req-b5f56ca0-43e1-4260-a4ab-54ae430e5aaf service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:23.362808 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-310a47be-0830-453c-b671-ffcb2ee5a33a req-b5f56ca0-43e1-4260-a4ab-54ae430e5aaf service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:23.363241 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-310a47be-0830-453c-b671-ffcb2ee5a33a req-b5f56ca0-43e1-4260-a4ab-54ae430e5aaf service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:23.375561 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.compute.server_external_events [req-310a47be-0830-453c-b671-ffcb2ee5a33a req-b5f56ca0-43e1-4260-a4ab-54ae430e5aaf service nova] Unable to find a host for instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3. Dropping event network-vif-unplugged {{(pid=120706) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 01:23:23.376496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-310a47be-0830-453c-b671-ffcb2ee5a33a req-b5f56ca0-43e1-4260-a4ab-54ae430e5aaf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032151 Aug 30 01:23:23.377084 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 358/716] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 01:23:24.035234 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a2e60270-a676-47bc-a053-fd61310d2e26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:24.035931 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a2e60270-a676-47bc-a053-fd61310d2e26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:24.042503 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a2e60270-a676-47bc-a053-fd61310d2e26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:24.043086 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a2e60270-a676-47bc-a053-fd61310d2e26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:24.043611 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a2e60270-a676-47bc-a053-fd61310d2e26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:24.044397 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a2e60270-a676-47bc-a053-fd61310d2e26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:24.044850 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a2e60270-a676-47bc-a053-fd61310d2e26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:24.045354 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a2e60270-a676-47bc-a053-fd61310d2e26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:24.180345 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a2e60270-a676-47bc-a053-fd61310d2e26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:24.189531 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a2e60270-a676-47bc-a053-fd61310d2e26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:24.193038 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a2e60270-a676-47bc-a053-fd61310d2e26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:24.193038 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a2e60270-a676-47bc-a053-fd61310d2e26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1753 microversion: 2.20 time: 0.160870 Aug 30 01:23:24.193038 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 359/717] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:24 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:25.217049 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-182b1898-97a8-4b00-99d3-080b4272baf5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:25.217694 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-182b1898-97a8-4b00-99d3-080b4272baf5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:25.224511 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-182b1898-97a8-4b00-99d3-080b4272baf5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:25.224998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-182b1898-97a8-4b00-99d3-080b4272baf5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:25.225437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-182b1898-97a8-4b00-99d3-080b4272baf5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:25.226126 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-182b1898-97a8-4b00-99d3-080b4272baf5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:25.226581 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-182b1898-97a8-4b00-99d3-080b4272baf5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:25.227011 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-182b1898-97a8-4b00-99d3-080b4272baf5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:25.245283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:25.368347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-182b1898-97a8-4b00-99d3-080b4272baf5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:25.377438 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-182b1898-97a8-4b00-99d3-080b4272baf5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:25.378887 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-182b1898-97a8-4b00-99d3-080b4272baf5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:25.380080 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-182b1898-97a8-4b00-99d3-080b4272baf5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.167752 Aug 30 01:23:25.380657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 359/718] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:25 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:26.412920 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f60e6df5-38c4-4e7a-b037-09ed2397de1f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:26.415706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f60e6df5-38c4-4e7a-b037-09ed2397de1f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:26.428282 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=65 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:26.433185 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f60e6df5-38c4-4e7a-b037-09ed2397de1f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:26.434366 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f60e6df5-38c4-4e7a-b037-09ed2397de1f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:26.441242 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f60e6df5-38c4-4e7a-b037-09ed2397de1f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:26.442621 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f60e6df5-38c4-4e7a-b037-09ed2397de1f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:26.443340 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f60e6df5-38c4-4e7a-b037-09ed2397de1f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:26.444031 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f60e6df5-38c4-4e7a-b037-09ed2397de1f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:26.602005 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f60e6df5-38c4-4e7a-b037-09ed2397de1f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:26.609766 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:26.618676 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f60e6df5-38c4-4e7a-b037-09ed2397de1f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:26.620179 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f60e6df5-38c4-4e7a-b037-09ed2397de1f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:26.623007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f60e6df5-38c4-4e7a-b037-09ed2397de1f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.220822 Aug 30 01:23:26.623859 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 360/719] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:26 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:27.647088 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e1fa978a-655d-4e3a-8fda-1ba833e7a6e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:27.647715 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e1fa978a-655d-4e3a-8fda-1ba833e7a6e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:27.650131 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:27.656955 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1fa978a-655d-4e3a-8fda-1ba833e7a6e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:27.657464 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1fa978a-655d-4e3a-8fda-1ba833e7a6e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:27.657994 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1fa978a-655d-4e3a-8fda-1ba833e7a6e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:27.658641 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1fa978a-655d-4e3a-8fda-1ba833e7a6e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:27.659125 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1fa978a-655d-4e3a-8fda-1ba833e7a6e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:27.659558 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1fa978a-655d-4e3a-8fda-1ba833e7a6e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:27.809978 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e1fa978a-655d-4e3a-8fda-1ba833e7a6e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:27.819449 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e1fa978a-655d-4e3a-8fda-1ba833e7a6e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:27.820924 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e1fa978a-655d-4e3a-8fda-1ba833e7a6e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:27.822131 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e1fa978a-655d-4e3a-8fda-1ba833e7a6e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.179035 Aug 30 01:23:27.822685 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 360/720] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:27 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:28.845289 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9ce9d376-2fa0-47ca-86c5-9729f11e8d97 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:28.846165 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9ce9d376-2fa0-47ca-86c5-9729f11e8d97 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:28.853754 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ce9d376-2fa0-47ca-86c5-9729f11e8d97 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:28.854694 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ce9d376-2fa0-47ca-86c5-9729f11e8d97 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:28.855508 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ce9d376-2fa0-47ca-86c5-9729f11e8d97 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:28.856255 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ce9d376-2fa0-47ca-86c5-9729f11e8d97 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:28.856711 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ce9d376-2fa0-47ca-86c5-9729f11e8d97 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:28.857144 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ce9d376-2fa0-47ca-86c5-9729f11e8d97 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:29.003220 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9ce9d376-2fa0-47ca-86c5-9729f11e8d97 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:29.012843 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9ce9d376-2fa0-47ca-86c5-9729f11e8d97 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:29.014284 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9ce9d376-2fa0-47ca-86c5-9729f11e8d97 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:29.015460 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9ce9d376-2fa0-47ca-86c5-9729f11e8d97 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.174338 Aug 30 01:23:29.020103 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 361/721] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:28 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:30.038775 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-54969f17-0615-41a6-8114-9737bfdecf4e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:30.039636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-54969f17-0615-41a6-8114-9737bfdecf4e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:30.046671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-54969f17-0615-41a6-8114-9737bfdecf4e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:30.047162 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-54969f17-0615-41a6-8114-9737bfdecf4e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:30.047599 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-54969f17-0615-41a6-8114-9737bfdecf4e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:30.048337 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-54969f17-0615-41a6-8114-9737bfdecf4e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:30.048793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-54969f17-0615-41a6-8114-9737bfdecf4e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:30.049291 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-54969f17-0615-41a6-8114-9737bfdecf4e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:30.190080 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-54969f17-0615-41a6-8114-9737bfdecf4e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:30.199728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-54969f17-0615-41a6-8114-9737bfdecf4e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:30.201894 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-54969f17-0615-41a6-8114-9737bfdecf4e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:30.203074 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-54969f17-0615-41a6-8114-9737bfdecf4e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.168260 Aug 30 01:23:30.203639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 361/722] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:30 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:31.227224 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1ae4e4f8-12ec-4ba9-b6f9-6b36c0b5f553 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:31.227832 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1ae4e4f8-12ec-4ba9-b6f9-6b36c0b5f553 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:31.234881 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1ae4e4f8-12ec-4ba9-b6f9-6b36c0b5f553 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:31.235409 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1ae4e4f8-12ec-4ba9-b6f9-6b36c0b5f553 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:31.235849 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1ae4e4f8-12ec-4ba9-b6f9-6b36c0b5f553 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:31.236587 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1ae4e4f8-12ec-4ba9-b6f9-6b36c0b5f553 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:31.237040 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1ae4e4f8-12ec-4ba9-b6f9-6b36c0b5f553 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:31.237469 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1ae4e4f8-12ec-4ba9-b6f9-6b36c0b5f553 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:31.381812 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1ae4e4f8-12ec-4ba9-b6f9-6b36c0b5f553 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:31.390758 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1ae4e4f8-12ec-4ba9-b6f9-6b36c0b5f553 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:31.392219 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1ae4e4f8-12ec-4ba9-b6f9-6b36c0b5f553 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:31.393387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1ae4e4f8-12ec-4ba9-b6f9-6b36c0b5f553 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.170245 Aug 30 01:23:31.393946 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 362/723] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:31 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:32.416470 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-038c5a83-bfa5-4c92-b65b-f4d2f3bcc51b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:32.419494 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-038c5a83-bfa5-4c92-b65b-f4d2f3bcc51b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:32.426247 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-038c5a83-bfa5-4c92-b65b-f4d2f3bcc51b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:32.426736 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-038c5a83-bfa5-4c92-b65b-f4d2f3bcc51b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:32.427172 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-038c5a83-bfa5-4c92-b65b-f4d2f3bcc51b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:32.427869 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-038c5a83-bfa5-4c92-b65b-f4d2f3bcc51b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:32.428355 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-038c5a83-bfa5-4c92-b65b-f4d2f3bcc51b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:32.428781 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-038c5a83-bfa5-4c92-b65b-f4d2f3bcc51b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:32.566531 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-038c5a83-bfa5-4c92-b65b-f4d2f3bcc51b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:32.576577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-038c5a83-bfa5-4c92-b65b-f4d2f3bcc51b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:32.578014 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-038c5a83-bfa5-4c92-b65b-f4d2f3bcc51b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:32.579290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-038c5a83-bfa5-4c92-b65b-f4d2f3bcc51b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.166800 Aug 30 01:23:32.580027 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 362/724] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:32 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:33.602905 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-abdfa097-8890-4f1b-a4aa-b1c28260b27b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:33.603517 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-abdfa097-8890-4f1b-a4aa-b1c28260b27b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:33.611276 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abdfa097-8890-4f1b-a4aa-b1c28260b27b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:33.611943 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abdfa097-8890-4f1b-a4aa-b1c28260b27b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:33.612391 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abdfa097-8890-4f1b-a4aa-b1c28260b27b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:33.613104 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abdfa097-8890-4f1b-a4aa-b1c28260b27b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:33.613562 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abdfa097-8890-4f1b-a4aa-b1c28260b27b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:33.614245 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abdfa097-8890-4f1b-a4aa-b1c28260b27b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:33.760942 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-abdfa097-8890-4f1b-a4aa-b1c28260b27b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:33.770744 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-abdfa097-8890-4f1b-a4aa-b1c28260b27b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:33.772233 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-abdfa097-8890-4f1b-a4aa-b1c28260b27b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:33.773413 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-abdfa097-8890-4f1b-a4aa-b1c28260b27b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.174496 Aug 30 01:23:33.773975 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 363/725] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:33 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:34.797885 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4aef6365-e59f-4ead-9168-3604c33089ac tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:34.799209 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4aef6365-e59f-4ead-9168-3604c33089ac tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:34.806318 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4aef6365-e59f-4ead-9168-3604c33089ac tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:34.806884 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4aef6365-e59f-4ead-9168-3604c33089ac tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:34.807386 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4aef6365-e59f-4ead-9168-3604c33089ac tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:34.809576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4aef6365-e59f-4ead-9168-3604c33089ac tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:34.810135 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4aef6365-e59f-4ead-9168-3604c33089ac tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:34.810634 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4aef6365-e59f-4ead-9168-3604c33089ac tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:34.955058 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4aef6365-e59f-4ead-9168-3604c33089ac tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:34.965516 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4aef6365-e59f-4ead-9168-3604c33089ac tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:34.966962 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4aef6365-e59f-4ead-9168-3604c33089ac tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:34.968158 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4aef6365-e59f-4ead-9168-3604c33089ac tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.174571 Aug 30 01:23:34.968722 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 363/726] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:34 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:35.991140 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-33be480d-8fdd-4a8e-be7e-553a2d9d91fa tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:35.991766 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-33be480d-8fdd-4a8e-be7e-553a2d9d91fa tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:35.998169 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33be480d-8fdd-4a8e-be7e-553a2d9d91fa tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:35.998650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33be480d-8fdd-4a8e-be7e-553a2d9d91fa tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:35.999084 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33be480d-8fdd-4a8e-be7e-553a2d9d91fa tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:35.999771 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33be480d-8fdd-4a8e-be7e-553a2d9d91fa tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:36.000245 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33be480d-8fdd-4a8e-be7e-553a2d9d91fa tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:36.000667 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33be480d-8fdd-4a8e-be7e-553a2d9d91fa tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:36.135146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-33be480d-8fdd-4a8e-be7e-553a2d9d91fa tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:36.144307 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-33be480d-8fdd-4a8e-be7e-553a2d9d91fa tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:36.145743 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-33be480d-8fdd-4a8e-be7e-553a2d9d91fa tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:36.146900 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-33be480d-8fdd-4a8e-be7e-553a2d9d91fa tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.160087 Aug 30 01:23:36.147459 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 364/727] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:35 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:37.171202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c403df17-592e-42fd-b5c1-b41c7d5f6543 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:37.171798 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c403df17-592e-42fd-b5c1-b41c7d5f6543 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:37.178427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c403df17-592e-42fd-b5c1-b41c7d5f6543 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:37.178906 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c403df17-592e-42fd-b5c1-b41c7d5f6543 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:37.179343 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c403df17-592e-42fd-b5c1-b41c7d5f6543 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:37.180062 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c403df17-592e-42fd-b5c1-b41c7d5f6543 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:37.180518 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c403df17-592e-42fd-b5c1-b41c7d5f6543 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:37.180941 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c403df17-592e-42fd-b5c1-b41c7d5f6543 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:37.311123 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c403df17-592e-42fd-b5c1-b41c7d5f6543 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:37.319741 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c403df17-592e-42fd-b5c1-b41c7d5f6543 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:37.321250 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c403df17-592e-42fd-b5c1-b41c7d5f6543 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:37.322409 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c403df17-592e-42fd-b5c1-b41c7d5f6543 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.156159 Aug 30 01:23:37.322972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 364/728] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:37 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:38.346004 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-487ec2f1-44f4-4b3e-a348-5ffbc624cdd2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:38.346629 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-487ec2f1-44f4-4b3e-a348-5ffbc624cdd2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:38.353391 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-487ec2f1-44f4-4b3e-a348-5ffbc624cdd2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:38.353880 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-487ec2f1-44f4-4b3e-a348-5ffbc624cdd2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:38.354318 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-487ec2f1-44f4-4b3e-a348-5ffbc624cdd2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:38.355083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-487ec2f1-44f4-4b3e-a348-5ffbc624cdd2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:38.355540 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-487ec2f1-44f4-4b3e-a348-5ffbc624cdd2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:38.355965 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-487ec2f1-44f4-4b3e-a348-5ffbc624cdd2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:38.488155 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-487ec2f1-44f4-4b3e-a348-5ffbc624cdd2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:38.497731 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-487ec2f1-44f4-4b3e-a348-5ffbc624cdd2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:38.499183 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-487ec2f1-44f4-4b3e-a348-5ffbc624cdd2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:38.500378 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-487ec2f1-44f4-4b3e-a348-5ffbc624cdd2 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.158213 Aug 30 01:23:38.500943 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 365/729] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:38 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:39.524692 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cad02b9d-6894-4044-9f42-63a9032a4b4c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:39.525408 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cad02b9d-6894-4044-9f42-63a9032a4b4c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:39.532696 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cad02b9d-6894-4044-9f42-63a9032a4b4c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:39.533174 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cad02b9d-6894-4044-9f42-63a9032a4b4c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:39.533604 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cad02b9d-6894-4044-9f42-63a9032a4b4c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:39.534299 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cad02b9d-6894-4044-9f42-63a9032a4b4c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:39.534743 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cad02b9d-6894-4044-9f42-63a9032a4b4c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:39.535162 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cad02b9d-6894-4044-9f42-63a9032a4b4c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:39.671292 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cad02b9d-6894-4044-9f42-63a9032a4b4c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:39.679943 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cad02b9d-6894-4044-9f42-63a9032a4b4c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:39.681418 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cad02b9d-6894-4044-9f42-63a9032a4b4c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:39.682584 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cad02b9d-6894-4044-9f42-63a9032a4b4c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.161830 Aug 30 01:23:39.683150 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 365/730] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:39 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:40.706285 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-72368f82-be17-4b42-bc05-df45caac7a41 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:40.706899 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-72368f82-be17-4b42-bc05-df45caac7a41 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:40.713107 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72368f82-be17-4b42-bc05-df45caac7a41 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:40.713900 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72368f82-be17-4b42-bc05-df45caac7a41 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:40.714012 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72368f82-be17-4b42-bc05-df45caac7a41 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:40.714698 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72368f82-be17-4b42-bc05-df45caac7a41 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:40.715143 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72368f82-be17-4b42-bc05-df45caac7a41 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:40.716116 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72368f82-be17-4b42-bc05-df45caac7a41 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:40.853844 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-72368f82-be17-4b42-bc05-df45caac7a41 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:40.863544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-72368f82-be17-4b42-bc05-df45caac7a41 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:40.865008 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-72368f82-be17-4b42-bc05-df45caac7a41 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:40.866168 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-72368f82-be17-4b42-bc05-df45caac7a41 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.164043 Aug 30 01:23:40.866730 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 366/731] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:40 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:41.888852 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-998cceeb-8a00-4089-82d8-346dbbee250d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:41.889496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-998cceeb-8a00-4089-82d8-346dbbee250d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:41.896331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-998cceeb-8a00-4089-82d8-346dbbee250d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:41.896819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-998cceeb-8a00-4089-82d8-346dbbee250d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:41.897260 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-998cceeb-8a00-4089-82d8-346dbbee250d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:41.897975 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-998cceeb-8a00-4089-82d8-346dbbee250d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:41.898414 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-998cceeb-8a00-4089-82d8-346dbbee250d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:41.898838 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-998cceeb-8a00-4089-82d8-346dbbee250d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:42.032486 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-998cceeb-8a00-4089-82d8-346dbbee250d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:42.041210 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-998cceeb-8a00-4089-82d8-346dbbee250d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:42.042662 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-998cceeb-8a00-4089-82d8-346dbbee250d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:42.044521 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-998cceeb-8a00-4089-82d8-346dbbee250d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.158989 Aug 30 01:23:42.045009 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 366/732] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:41 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:43.067275 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ea7a96c0-4abf-4408-8ca8-8a4e7eea1962 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:43.067822 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ea7a96c0-4abf-4408-8ca8-8a4e7eea1962 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:43.074456 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea7a96c0-4abf-4408-8ca8-8a4e7eea1962 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:43.074957 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea7a96c0-4abf-4408-8ca8-8a4e7eea1962 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:43.075393 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea7a96c0-4abf-4408-8ca8-8a4e7eea1962 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:43.076116 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea7a96c0-4abf-4408-8ca8-8a4e7eea1962 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:43.076565 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea7a96c0-4abf-4408-8ca8-8a4e7eea1962 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:43.076982 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea7a96c0-4abf-4408-8ca8-8a4e7eea1962 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:43.210895 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ea7a96c0-4abf-4408-8ca8-8a4e7eea1962 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:43.220273 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ea7a96c0-4abf-4408-8ca8-8a4e7eea1962 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:43.221720 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ea7a96c0-4abf-4408-8ca8-8a4e7eea1962 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:43.222875 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ea7a96c0-4abf-4408-8ca8-8a4e7eea1962 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.159653 Aug 30 01:23:43.223446 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 367/733] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:43 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:44.247802 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cee76dfe-2705-4ae5-a4a1-f61d1a789f99 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:44.248467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cee76dfe-2705-4ae5-a4a1-f61d1a789f99 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:44.255265 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cee76dfe-2705-4ae5-a4a1-f61d1a789f99 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:44.255740 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cee76dfe-2705-4ae5-a4a1-f61d1a789f99 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:44.256215 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cee76dfe-2705-4ae5-a4a1-f61d1a789f99 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:44.256908 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cee76dfe-2705-4ae5-a4a1-f61d1a789f99 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:44.257356 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cee76dfe-2705-4ae5-a4a1-f61d1a789f99 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:44.257769 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cee76dfe-2705-4ae5-a4a1-f61d1a789f99 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:44.385847 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cee76dfe-2705-4ae5-a4a1-f61d1a789f99 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:44.394682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cee76dfe-2705-4ae5-a4a1-f61d1a789f99 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:44.396144 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cee76dfe-2705-4ae5-a4a1-f61d1a789f99 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:44.397325 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cee76dfe-2705-4ae5-a4a1-f61d1a789f99 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.154077 Aug 30 01:23:44.397869 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 367/734] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:44 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:45.421393 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c76d7e97-92d9-48d1-a1b2-622aee2d7b26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:45.422119 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c76d7e97-92d9-48d1-a1b2-622aee2d7b26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:45.428862 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c76d7e97-92d9-48d1-a1b2-622aee2d7b26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:45.429467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c76d7e97-92d9-48d1-a1b2-622aee2d7b26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:45.429790 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c76d7e97-92d9-48d1-a1b2-622aee2d7b26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:45.430494 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c76d7e97-92d9-48d1-a1b2-622aee2d7b26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:45.430958 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c76d7e97-92d9-48d1-a1b2-622aee2d7b26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:45.431395 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c76d7e97-92d9-48d1-a1b2-622aee2d7b26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:45.565354 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c76d7e97-92d9-48d1-a1b2-622aee2d7b26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:45.574026 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c76d7e97-92d9-48d1-a1b2-622aee2d7b26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:45.576116 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c76d7e97-92d9-48d1-a1b2-622aee2d7b26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:45.577284 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c76d7e97-92d9-48d1-a1b2-622aee2d7b26 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.160605 Aug 30 01:23:45.577840 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 368/735] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:45 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:46.601029 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-785da68a-d35d-4e95-8e41-a8ed7da387f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:46.601707 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-785da68a-d35d-4e95-8e41-a8ed7da387f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:46.609055 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-785da68a-d35d-4e95-8e41-a8ed7da387f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:46.609542 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-785da68a-d35d-4e95-8e41-a8ed7da387f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:46.609980 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-785da68a-d35d-4e95-8e41-a8ed7da387f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:46.615239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-785da68a-d35d-4e95-8e41-a8ed7da387f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:46.615239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-785da68a-d35d-4e95-8e41-a8ed7da387f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:46.615239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-785da68a-d35d-4e95-8e41-a8ed7da387f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:46.747154 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-785da68a-d35d-4e95-8e41-a8ed7da387f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:46.755767 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-785da68a-d35d-4e95-8e41-a8ed7da387f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:46.757239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-785da68a-d35d-4e95-8e41-a8ed7da387f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:46.758391 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-785da68a-d35d-4e95-8e41-a8ed7da387f3 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.161378 Aug 30 01:23:46.758949 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 368/736] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:46 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:47.418864 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-2e48eef5-7fb1-4397-bec4-52b82e0f9f20 req-894066d7-5998-4dc7-b9d2-7d3447573518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa5b2d0-a841-4330-998e-ecb58b4ef9f3", "name": "network-vif-plugged", "status": "completed", "tag": "4ccc2f03-e4d5-41df-ae6e-d6c35f2a9ef3"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:47.429894 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-2e48eef5-7fb1-4397-bec4-52b82e0f9f20 req-894066d7-5998-4dc7-b9d2-7d3447573518 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:47.430344 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-2e48eef5-7fb1-4397-bec4-52b82e0f9f20 req-894066d7-5998-4dc7-b9d2-7d3447573518 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:47.430786 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-2e48eef5-7fb1-4397-bec4-52b82e0f9f20 req-894066d7-5998-4dc7-b9d2-7d3447573518 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:47.445546 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-2e48eef5-7fb1-4397-bec4-52b82e0f9f20 req-894066d7-5998-4dc7-b9d2-7d3447573518 service nova] Creating event network-vif-plugged:4ccc2f03-e4d5-41df-ae6e-d6c35f2a9ef3 for instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 on hv-cinder-81514 Aug 30 01:23:47.451810 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-2e48eef5-7fb1-4397-bec4-52b82e0f9f20 req-894066d7-5998-4dc7-b9d2-7d3447573518 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036664 Aug 30 01:23:47.452628 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 369/737] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:23:47.782130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a765e9af-3141-4e3c-8843-00bd6f4fb9e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:47.782731 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a765e9af-3141-4e3c-8843-00bd6f4fb9e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:47.789710 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a765e9af-3141-4e3c-8843-00bd6f4fb9e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:47.790203 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a765e9af-3141-4e3c-8843-00bd6f4fb9e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:47.790633 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a765e9af-3141-4e3c-8843-00bd6f4fb9e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:47.791339 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a765e9af-3141-4e3c-8843-00bd6f4fb9e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:47.791791 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a765e9af-3141-4e3c-8843-00bd6f4fb9e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:47.792255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a765e9af-3141-4e3c-8843-00bd6f4fb9e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:47.931106 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a765e9af-3141-4e3c-8843-00bd6f4fb9e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:47.940558 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a765e9af-3141-4e3c-8843-00bd6f4fb9e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:47.942005 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a765e9af-3141-4e3c-8843-00bd6f4fb9e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:47.943185 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a765e9af-3141-4e3c-8843-00bd6f4fb9e4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.165393 Aug 30 01:23:47.943954 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 369/738] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:47 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:48.968577 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e439dece-787e-448f-a7e9-aa32c427fca0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:48.969193 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e439dece-787e-448f-a7e9-aa32c427fca0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:48.975588 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e439dece-787e-448f-a7e9-aa32c427fca0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:48.976101 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e439dece-787e-448f-a7e9-aa32c427fca0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:48.976543 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e439dece-787e-448f-a7e9-aa32c427fca0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:48.977243 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e439dece-787e-448f-a7e9-aa32c427fca0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:48.977693 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e439dece-787e-448f-a7e9-aa32c427fca0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:48.978115 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e439dece-787e-448f-a7e9-aa32c427fca0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:49.126885 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e439dece-787e-448f-a7e9-aa32c427fca0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:49.136965 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e439dece-787e-448f-a7e9-aa32c427fca0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:49.138410 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e439dece-787e-448f-a7e9-aa32c427fca0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:49.139581 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e439dece-787e-448f-a7e9-aa32c427fca0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.176785 Aug 30 01:23:49.140177 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 370/739] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:48 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:50.180750 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3dc00fc6-4602-4de2-ae49-09623a0a3fce tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:50.181452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3dc00fc6-4602-4de2-ae49-09623a0a3fce tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:50.188254 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3dc00fc6-4602-4de2-ae49-09623a0a3fce tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:50.188727 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3dc00fc6-4602-4de2-ae49-09623a0a3fce tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:50.189168 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3dc00fc6-4602-4de2-ae49-09623a0a3fce tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:50.189874 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3dc00fc6-4602-4de2-ae49-09623a0a3fce tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:50.190328 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3dc00fc6-4602-4de2-ae49-09623a0a3fce tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:50.190756 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3dc00fc6-4602-4de2-ae49-09623a0a3fce tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:50.335777 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3dc00fc6-4602-4de2-ae49-09623a0a3fce tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:50.349589 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3dc00fc6-4602-4de2-ae49-09623a0a3fce tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:50.351798 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3dc00fc6-4602-4de2-ae49-09623a0a3fce tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:50.353002 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3dc00fc6-4602-4de2-ae49-09623a0a3fce tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1809 microversion: 2.20 time: 0.176177 Aug 30 01:23:50.353568 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 370/740] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:50 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:51.377811 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e704efaa-de10-4f45-85c9-24ae3d326032 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:51.378406 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e704efaa-de10-4f45-85c9-24ae3d326032 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:51.385440 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e704efaa-de10-4f45-85c9-24ae3d326032 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:51.385930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e704efaa-de10-4f45-85c9-24ae3d326032 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:51.386379 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e704efaa-de10-4f45-85c9-24ae3d326032 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:51.387076 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e704efaa-de10-4f45-85c9-24ae3d326032 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:51.387530 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e704efaa-de10-4f45-85c9-24ae3d326032 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:51.387955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e704efaa-de10-4f45-85c9-24ae3d326032 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:51.522199 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e704efaa-de10-4f45-85c9-24ae3d326032 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:51.531327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e704efaa-de10-4f45-85c9-24ae3d326032 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:51.532800 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e704efaa-de10-4f45-85c9-24ae3d326032 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:51.534011 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e704efaa-de10-4f45-85c9-24ae3d326032 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1796 microversion: 2.20 time: 0.160216 Aug 30 01:23:51.534585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 371/741] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:23:51 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1796 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:23:55.030285 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-35846090-e377-4f8d-a6ea-d04a20521e13 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:55.030833 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-35846090-e377-4f8d-a6ea-d04a20521e13 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:55.036765 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35846090-e377-4f8d-a6ea-d04a20521e13 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:55.037240 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35846090-e377-4f8d-a6ea-d04a20521e13 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:55.037668 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35846090-e377-4f8d-a6ea-d04a20521e13 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:55.038348 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35846090-e377-4f8d-a6ea-d04a20521e13 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:55.038790 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35846090-e377-4f8d-a6ea-d04a20521e13 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:55.039206 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35846090-e377-4f8d-a6ea-d04a20521e13 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:55.062507 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-35846090-e377-4f8d-a6ea-d04a20521e13 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1/ips" status: 200 len: 149 microversion: 2.1 time: 0.036909 Aug 30 01:23:55.063081 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 371/742] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Aug 30 01:23:55 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:23:56.506332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ef4a3e9e-434d-48ad-ba7f-8fc5a0c30a47 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dd0eea5-bc74-4e7b-aaa7-1c3fc3c9affd"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:56.508675 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ef4a3e9e-434d-48ad-ba7f-8fc5a0c30a47 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:56.511090 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=24 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:56.516390 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef4a3e9e-434d-48ad-ba7f-8fc5a0c30a47 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:56.516859 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef4a3e9e-434d-48ad-ba7f-8fc5a0c30a47 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:56.517286 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef4a3e9e-434d-48ad-ba7f-8fc5a0c30a47 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:56.517963 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef4a3e9e-434d-48ad-ba7f-8fc5a0c30a47 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:56.518406 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef4a3e9e-434d-48ad-ba7f-8fc5a0c30a47 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:56.518826 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef4a3e9e-434d-48ad-ba7f-8fc5a0c30a47 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:56.789340 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ef4a3e9e-434d-48ad-ba7f-8fc5a0c30a47 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "POST /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286891 Aug 30 01:23:56.789951 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 372/743] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:23:56 2022] POST /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:04.333322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e3050cf1-fa0d-4388-90bd-ec078635c35c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Action: 'create', calling method: .version_select at 0x7ff48ad5de50>, body: {"keypair": {"name": "tempest-keypair-1386963757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLs6ogp+fVVtFtdW26vZc4VsiMhJDUqvuGFfzyef8dPSM4HVJNW88pFTUnimKOkVkp8fY4lBgzDj8YOqdt6TbwWCaVEFCn0XP8jLT7WnGT4z7Wip+kHRhm1/leE1MfFVQg=="}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:04.341182 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=24 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:04.351037 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-e3050cf1-fa0d-4388-90bd-ec078635c35c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for project f5ddbf041c444253aea027770188fbaf. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:24:04.356117 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-e3050cf1-fa0d-4388-90bd-ec078635c35c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for user 4fe36a87392c40379ac160ebaa3cd84c and project f5ddbf041c444253aea027770188fbaf. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:24:04.379115 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e3050cf1-fa0d-4388-90bd-ec078635c35c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049538 Aug 30 01:24:04.380027 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 372/744] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Aug 30 01:24:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:05.879247 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1528492324", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "129a2c61-8cde-4190-8f30-dda20a50e18f"}], "security_groups": [{"name": "tempest-securitygroup--1043585108"}], "key_name": "tempest-keypair-1386963757", "user_data": "}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:05.987154 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] validate_networks() for [('129a2c61-8cde-4190-8f30-dda20a50e18f', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:24:06.360859 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:24:06.361543 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:24:06.362012 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:24:06.362417 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:24:06.362824 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:24:06.371918 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:06.372430 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:06.372865 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:06.373594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:06.374043 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:06.374465 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:06.381236 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:06.393817 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for project f5ddbf041c444253aea027770188fbaf. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:24:06.397799 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for user 4fe36a87392c40379ac160ebaa3cd84c and project f5ddbf041c444253aea027770188fbaf. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:24:06.409174 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:24:06.411541 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:24:06.457888 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-10d12865-d2a4-4010-a64d-16f572ffcafd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.583852 Aug 30 01:24:06.458569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 373/745] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:24:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:24:06.466749 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=72 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:06.471331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f5ead551-fc7e-48a3-976c-188d916004f1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:06.471944 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f5ead551-fc7e-48a3-976c-188d916004f1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:06.528838 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f5ead551-fc7e-48a3-976c-188d916004f1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:06.536036 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f5ead551-fc7e-48a3-976c-188d916004f1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1242 microversion: 2.1 time: 0.069911 Aug 30 01:24:06.536609 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 373/746] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:06 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:07.558115 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b9f2a292-0181-4921-b2ce-b6d6380b757d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:07.558832 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b9f2a292-0181-4921-b2ce-b6d6380b757d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:07.565169 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9f2a292-0181-4921-b2ce-b6d6380b757d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:07.565652 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9f2a292-0181-4921-b2ce-b6d6380b757d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:07.566097 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9f2a292-0181-4921-b2ce-b6d6380b757d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:07.566784 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9f2a292-0181-4921-b2ce-b6d6380b757d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:07.567234 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9f2a292-0181-4921-b2ce-b6d6380b757d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:07.567659 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9f2a292-0181-4921-b2ce-b6d6380b757d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:07.632272 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b9f2a292-0181-4921-b2ce-b6d6380b757d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:07.641511 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b9f2a292-0181-4921-b2ce-b6d6380b757d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1294 microversion: 2.1 time: 0.088401 Aug 30 01:24:07.642210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 374/747] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:07 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:08.663956 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e75d59cc-3751-499a-bc0b-45bd49070c3a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:08.664592 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e75d59cc-3751-499a-bc0b-45bd49070c3a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:08.672044 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e75d59cc-3751-499a-bc0b-45bd49070c3a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:08.672569 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e75d59cc-3751-499a-bc0b-45bd49070c3a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:08.673052 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e75d59cc-3751-499a-bc0b-45bd49070c3a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:08.673763 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e75d59cc-3751-499a-bc0b-45bd49070c3a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:08.674223 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e75d59cc-3751-499a-bc0b-45bd49070c3a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:08.674650 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e75d59cc-3751-499a-bc0b-45bd49070c3a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:08.901940 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e75d59cc-3751-499a-bc0b-45bd49070c3a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:08.910169 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e75d59cc-3751-499a-bc0b-45bd49070c3a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1368 microversion: 2.1 time: 0.249979 Aug 30 01:24:08.910752 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 374/748] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:08 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:09.477117 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-a3633e0f-df56-4a32-8ce5-91b77a4e0a29 req-3eeb773a-069e-4cf7-9b03-10a74d91ca55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f305831-eafb-4667-a621-cb2bf89c07c1", "tag": "a39b7371-7db0-4120-85ff-91de9d57b615"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:09.488142 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a3633e0f-df56-4a32-8ce5-91b77a4e0a29 req-3eeb773a-069e-4cf7-9b03-10a74d91ca55 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:09.488630 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a3633e0f-df56-4a32-8ce5-91b77a4e0a29 req-3eeb773a-069e-4cf7-9b03-10a74d91ca55 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:09.489177 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a3633e0f-df56-4a32-8ce5-91b77a4e0a29 req-3eeb773a-069e-4cf7-9b03-10a74d91ca55 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:09.500712 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-a3633e0f-df56-4a32-8ce5-91b77a4e0a29 req-3eeb773a-069e-4cf7-9b03-10a74d91ca55 service nova] Creating event network-changed:a39b7371-7db0-4120-85ff-91de9d57b615 for instance 1f305831-eafb-4667-a621-cb2bf89c07c1 on hv-cinder-81514 Aug 30 01:24:09.505601 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-a3633e0f-df56-4a32-8ce5-91b77a4e0a29 req-3eeb773a-069e-4cf7-9b03-10a74d91ca55 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032139 Aug 30 01:24:09.506179 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 375/749] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:09.931113 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-709a866e-61e0-476e-9f66-ad884ed39558 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:09.931725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-709a866e-61e0-476e-9f66-ad884ed39558 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:09.939132 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-709a866e-61e0-476e-9f66-ad884ed39558 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:09.939618 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-709a866e-61e0-476e-9f66-ad884ed39558 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:09.940084 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-709a866e-61e0-476e-9f66-ad884ed39558 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:09.940807 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-709a866e-61e0-476e-9f66-ad884ed39558 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:09.941255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-709a866e-61e0-476e-9f66-ad884ed39558 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:09.941680 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-709a866e-61e0-476e-9f66-ad884ed39558 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:10.070775 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-709a866e-61e0-476e-9f66-ad884ed39558 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:10.079637 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-709a866e-61e0-476e-9f66-ad884ed39558 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1368 microversion: 2.1 time: 0.152462 Aug 30 01:24:10.080246 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 375/750] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:09 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:11.101579 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7af01356-8894-427e-8451-496174fef9ef tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:11.102275 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7af01356-8894-427e-8451-496174fef9ef tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:11.109262 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7af01356-8894-427e-8451-496174fef9ef tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:11.109739 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7af01356-8894-427e-8451-496174fef9ef tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:11.110181 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7af01356-8894-427e-8451-496174fef9ef tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:11.111131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7af01356-8894-427e-8451-496174fef9ef tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:11.111581 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7af01356-8894-427e-8451-496174fef9ef tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:11.112051 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7af01356-8894-427e-8451-496174fef9ef tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:11.253999 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7af01356-8894-427e-8451-496174fef9ef tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:11.262233 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7af01356-8894-427e-8451-496174fef9ef tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1368 microversion: 2.1 time: 0.165245 Aug 30 01:24:11.262803 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 376/751] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:11 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:12.283005 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8877aa56-b461-4f24-8ab9-752d9d71363d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:12.283613 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8877aa56-b461-4f24-8ab9-752d9d71363d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:12.290270 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8877aa56-b461-4f24-8ab9-752d9d71363d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:12.290754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8877aa56-b461-4f24-8ab9-752d9d71363d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:12.291188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8877aa56-b461-4f24-8ab9-752d9d71363d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:12.292024 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8877aa56-b461-4f24-8ab9-752d9d71363d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:12.293062 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8877aa56-b461-4f24-8ab9-752d9d71363d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:12.293494 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8877aa56-b461-4f24-8ab9-752d9d71363d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:12.433239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8877aa56-b461-4f24-8ab9-752d9d71363d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:12.441316 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8877aa56-b461-4f24-8ab9-752d9d71363d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1368 microversion: 2.1 time: 0.162074 Aug 30 01:24:12.441887 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 376/752] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:12 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:13.461030 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f32288bf-6845-4220-91ea-c5015438b31a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:13.461640 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f32288bf-6845-4220-91ea-c5015438b31a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:13.469172 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f32288bf-6845-4220-91ea-c5015438b31a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:13.469641 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f32288bf-6845-4220-91ea-c5015438b31a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:13.470070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f32288bf-6845-4220-91ea-c5015438b31a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:13.470755 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f32288bf-6845-4220-91ea-c5015438b31a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:13.471195 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f32288bf-6845-4220-91ea-c5015438b31a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:13.471607 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f32288bf-6845-4220-91ea-c5015438b31a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:13.608407 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f32288bf-6845-4220-91ea-c5015438b31a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:13.616654 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f32288bf-6845-4220-91ea-c5015438b31a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1368 microversion: 2.1 time: 0.159423 Aug 30 01:24:13.617241 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 377/753] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:13 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:14.637758 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7eaad33f-5555-4d35-b5bc-1a2511f46e98 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:14.638335 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7eaad33f-5555-4d35-b5bc-1a2511f46e98 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:14.645428 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7eaad33f-5555-4d35-b5bc-1a2511f46e98 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:14.645868 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7eaad33f-5555-4d35-b5bc-1a2511f46e98 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:14.646313 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7eaad33f-5555-4d35-b5bc-1a2511f46e98 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:14.647016 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7eaad33f-5555-4d35-b5bc-1a2511f46e98 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:14.647575 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7eaad33f-5555-4d35-b5bc-1a2511f46e98 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:14.647952 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7eaad33f-5555-4d35-b5bc-1a2511f46e98 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:14.778682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7eaad33f-5555-4d35-b5bc-1a2511f46e98 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:14.786423 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7eaad33f-5555-4d35-b5bc-1a2511f46e98 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1368 microversion: 2.1 time: 0.153091 Aug 30 01:24:14.787016 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 377/754] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:14 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:15.585240 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-08ac0862-2e1c-4cbb-b6a0-7259b7537b09 req-f8c873e3-c3c2-4137-96af-8241dff6eee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f305831-eafb-4667-a621-cb2bf89c07c1", "name": "network-vif-plugged", "status": "completed", "tag": "a39b7371-7db0-4120-85ff-91de9d57b615"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:15.595499 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-08ac0862-2e1c-4cbb-b6a0-7259b7537b09 req-f8c873e3-c3c2-4137-96af-8241dff6eee9 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:15.596227 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-08ac0862-2e1c-4cbb-b6a0-7259b7537b09 req-f8c873e3-c3c2-4137-96af-8241dff6eee9 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:15.596659 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-08ac0862-2e1c-4cbb-b6a0-7259b7537b09 req-f8c873e3-c3c2-4137-96af-8241dff6eee9 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:15.609160 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-08ac0862-2e1c-4cbb-b6a0-7259b7537b09 req-f8c873e3-c3c2-4137-96af-8241dff6eee9 service nova] Creating event network-vif-plugged:a39b7371-7db0-4120-85ff-91de9d57b615 for instance 1f305831-eafb-4667-a621-cb2bf89c07c1 on hv-cinder-81514 Aug 30 01:24:15.614598 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-08ac0862-2e1c-4cbb-b6a0-7259b7537b09 req-f8c873e3-c3c2-4137-96af-8241dff6eee9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033030 Aug 30 01:24:15.615210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 378/755] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:15.807778 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-596d120c-7f73-4dac-88fd-930b7487ced6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:15.808529 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-596d120c-7f73-4dac-88fd-930b7487ced6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:15.815243 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-596d120c-7f73-4dac-88fd-930b7487ced6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:15.815843 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-596d120c-7f73-4dac-88fd-930b7487ced6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:15.816433 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-596d120c-7f73-4dac-88fd-930b7487ced6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:15.817143 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-596d120c-7f73-4dac-88fd-930b7487ced6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:15.817604 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-596d120c-7f73-4dac-88fd-930b7487ced6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:15.818030 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-596d120c-7f73-4dac-88fd-930b7487ced6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:15.975403 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-596d120c-7f73-4dac-88fd-930b7487ced6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:15.984060 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-596d120c-7f73-4dac-88fd-930b7487ced6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1368 microversion: 2.1 time: 0.180975 Aug 30 01:24:15.984625 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 378/756] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:15 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:17.003581 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:17.004377 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:17.009673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4a3d438f-691e-4ec3-93f2-558b9b9353f3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:17.010872 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4a3d438f-691e-4ec3-93f2-558b9b9353f3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:17.018211 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a3d438f-691e-4ec3-93f2-558b9b9353f3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:17.018693 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a3d438f-691e-4ec3-93f2-558b9b9353f3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:17.019138 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a3d438f-691e-4ec3-93f2-558b9b9353f3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:17.019832 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a3d438f-691e-4ec3-93f2-558b9b9353f3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:17.020312 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a3d438f-691e-4ec3-93f2-558b9b9353f3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:17.020738 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a3d438f-691e-4ec3-93f2-558b9b9353f3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:17.215689 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4a3d438f-691e-4ec3-93f2-558b9b9353f3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:17.223365 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4a3d438f-691e-4ec3-93f2-558b9b9353f3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1368 microversion: 2.1 time: 0.220682 Aug 30 01:24:17.223950 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 379/757] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:17 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:17.317187 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fb74263e-b355-4567-8304-68c96ea0a8f9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:17.317838 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fb74263e-b355-4567-8304-68c96ea0a8f9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:17.327810 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-d705d37e-4b8d-4cfe-8cfa-6024ecebabb9 req-8f88e648-24ca-4ccd-aead-b680be785f23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68833d42-7eed-4b4c-b315-842b9c015dfd", "tag": "90cf8014-421d-45c2-8701-cc67f5ad29d1"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:17.330815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:17.333562 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb74263e-b355-4567-8304-68c96ea0a8f9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:17.334090 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb74263e-b355-4567-8304-68c96ea0a8f9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:17.334958 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb74263e-b355-4567-8304-68c96ea0a8f9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:17.335673 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb74263e-b355-4567-8304-68c96ea0a8f9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:17.336172 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb74263e-b355-4567-8304-68c96ea0a8f9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:17.336597 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb74263e-b355-4567-8304-68c96ea0a8f9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:17.346875 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-d705d37e-4b8d-4cfe-8cfa-6024ecebabb9 req-8f88e648-24ca-4ccd-aead-b680be785f23 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:17.349110 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-d705d37e-4b8d-4cfe-8cfa-6024ecebabb9 req-8f88e648-24ca-4ccd-aead-b680be785f23 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:17.349110 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-d705d37e-4b8d-4cfe-8cfa-6024ecebabb9 req-8f88e648-24ca-4ccd-aead-b680be785f23 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:17.362078 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-d705d37e-4b8d-4cfe-8cfa-6024ecebabb9 req-8f88e648-24ca-4ccd-aead-b680be785f23 service nova] Creating event network-changed:90cf8014-421d-45c2-8701-cc67f5ad29d1 for instance 68833d42-7eed-4b4c-b315-842b9c015dfd on hv-cinder-81514 Aug 30 01:24:17.367217 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-d705d37e-4b8d-4cfe-8cfa-6024ecebabb9 req-8f88e648-24ca-4ccd-aead-b680be785f23 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044835 Aug 30 01:24:17.368044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 380/758] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:17.371642 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fb74263e-b355-4567-8304-68c96ea0a8f9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:24:17.461918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fb74263e-b355-4567-8304-68c96ea0a8f9 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "DELETE /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 204 len: 0 microversion: 2.1 time: 0.148702 Aug 30 01:24:17.462982 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 379/759] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:24:17 2022] DELETE /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:24:17.471488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3d69c5da-4910-4e9f-a376-bfc19a9f23ed tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:17.472428 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3d69c5da-4910-4e9f-a376-bfc19a9f23ed tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:17.479307 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3d69c5da-4910-4e9f-a376-bfc19a9f23ed tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:17.480122 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3d69c5da-4910-4e9f-a376-bfc19a9f23ed tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:17.480752 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3d69c5da-4910-4e9f-a376-bfc19a9f23ed tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:17.481625 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3d69c5da-4910-4e9f-a376-bfc19a9f23ed tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:17.482549 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3d69c5da-4910-4e9f-a376-bfc19a9f23ed tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:17.483211 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3d69c5da-4910-4e9f-a376-bfc19a9f23ed tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:17.715470 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3d69c5da-4910-4e9f-a376-bfc19a9f23ed tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:17.723218 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3d69c5da-4910-4e9f-a376-bfc19a9f23ed tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.255961 Aug 30 01:24:17.723982 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 381/760] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:17 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:18.247069 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c220cef4-314c-4dbc-abd1-94a76da15034 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:18.247864 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c220cef4-314c-4dbc-abd1-94a76da15034 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:18.254208 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c220cef4-314c-4dbc-abd1-94a76da15034 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:18.254704 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c220cef4-314c-4dbc-abd1-94a76da15034 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:18.255105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c220cef4-314c-4dbc-abd1-94a76da15034 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:18.255795 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c220cef4-314c-4dbc-abd1-94a76da15034 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:18.256268 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c220cef4-314c-4dbc-abd1-94a76da15034 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:18.256689 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c220cef4-314c-4dbc-abd1-94a76da15034 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:18.400322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c220cef4-314c-4dbc-abd1-94a76da15034 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:18.411620 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c220cef4-314c-4dbc-abd1-94a76da15034 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1559 microversion: 2.1 time: 0.169635 Aug 30 01:24:18.412430 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 380/761] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:18 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:18.431633 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-169f0745-6772-4e68-a786-1ccf23a87c71 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:18.432383 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-169f0745-6772-4e68-a786-1ccf23a87c71 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:18.438683 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-169f0745-6772-4e68-a786-1ccf23a87c71 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:18.439157 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-169f0745-6772-4e68-a786-1ccf23a87c71 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:18.439596 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-169f0745-6772-4e68-a786-1ccf23a87c71 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:18.440314 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-169f0745-6772-4e68-a786-1ccf23a87c71 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:18.440765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-169f0745-6772-4e68-a786-1ccf23a87c71 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:18.441192 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-169f0745-6772-4e68-a786-1ccf23a87c71 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:18.519628 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-169f0745-6772-4e68-a786-1ccf23a87c71 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091748 Aug 30 01:24:18.520267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 382/762] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Aug 30 01:24:18 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:18.746329 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8eae626f-4f4a-4275-8c24-95b0fc0b4f5d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:18.746946 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8eae626f-4f4a-4275-8c24-95b0fc0b4f5d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:18.753064 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8eae626f-4f4a-4275-8c24-95b0fc0b4f5d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:18.753553 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8eae626f-4f4a-4275-8c24-95b0fc0b4f5d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:18.753993 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8eae626f-4f4a-4275-8c24-95b0fc0b4f5d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:18.754684 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8eae626f-4f4a-4275-8c24-95b0fc0b4f5d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:18.755135 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8eae626f-4f4a-4275-8c24-95b0fc0b4f5d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:18.755560 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8eae626f-4f4a-4275-8c24-95b0fc0b4f5d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:19.074043 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8eae626f-4f4a-4275-8c24-95b0fc0b4f5d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:19.082349 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8eae626f-4f4a-4275-8c24-95b0fc0b4f5d tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1568 microversion: 2.1 time: 0.340536 Aug 30 01:24:19.082929 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 381/763] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:18 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1568 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:19.877267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-b71f1f5c-7c68-4a32-ab10-cf7280829c30 req-df5fa15a-25d3-4d88-b470-3bceaef9027f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f305831-eafb-4667-a621-cb2bf89c07c1", "tag": "a39b7371-7db0-4120-85ff-91de9d57b615"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:19.891395 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b71f1f5c-7c68-4a32-ab10-cf7280829c30 req-df5fa15a-25d3-4d88-b470-3bceaef9027f service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:19.892740 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b71f1f5c-7c68-4a32-ab10-cf7280829c30 req-df5fa15a-25d3-4d88-b470-3bceaef9027f service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:19.893401 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b71f1f5c-7c68-4a32-ab10-cf7280829c30 req-df5fa15a-25d3-4d88-b470-3bceaef9027f service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:19.909988 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-b71f1f5c-7c68-4a32-ab10-cf7280829c30 req-df5fa15a-25d3-4d88-b470-3bceaef9027f service nova] Creating event network-changed:a39b7371-7db0-4120-85ff-91de9d57b615 for instance 1f305831-eafb-4667-a621-cb2bf89c07c1 on hv-cinder-81514 Aug 30 01:24:19.915359 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-b71f1f5c-7c68-4a32-ab10-cf7280829c30 req-df5fa15a-25d3-4d88-b470-3bceaef9027f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044018 Aug 30 01:24:19.915965 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 383/764] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:20.007230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-f0fe326f-92af-4c6f-9477-5d5320daa816 req-8cb6abb2-ea7b-485f-abcd-6da6d7f1942c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68833d42-7eed-4b4c-b315-842b9c015dfd", "name": "network-vif-deleted", "tag": "90cf8014-421d-45c2-8701-cc67f5ad29d1"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:20.019410 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-f0fe326f-92af-4c6f-9477-5d5320daa816 req-8cb6abb2-ea7b-485f-abcd-6da6d7f1942c service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:20.019913 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-f0fe326f-92af-4c6f-9477-5d5320daa816 req-8cb6abb2-ea7b-485f-abcd-6da6d7f1942c service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:20.020453 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-f0fe326f-92af-4c6f-9477-5d5320daa816 req-8cb6abb2-ea7b-485f-abcd-6da6d7f1942c service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:20.037205 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-f0fe326f-92af-4c6f-9477-5d5320daa816 req-8cb6abb2-ea7b-485f-abcd-6da6d7f1942c service nova] Creating event network-vif-deleted:90cf8014-421d-45c2-8701-cc67f5ad29d1 for instance 68833d42-7eed-4b4c-b315-842b9c015dfd on hv-cinder-81514 Aug 30 01:24:20.043358 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-f0fe326f-92af-4c6f-9477-5d5320daa816 req-8cb6abb2-ea7b-485f-abcd-6da6d7f1942c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039723 Aug 30 01:24:20.046761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 382/765] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:20.104644 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e7399524-7ecf-4cb8-8277-ffff81f59d61 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:20.105756 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e7399524-7ecf-4cb8-8277-ffff81f59d61 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:20.112889 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e7399524-7ecf-4cb8-8277-ffff81f59d61 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:20.113624 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e7399524-7ecf-4cb8-8277-ffff81f59d61 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:20.114057 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e7399524-7ecf-4cb8-8277-ffff81f59d61 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:20.114748 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e7399524-7ecf-4cb8-8277-ffff81f59d61 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:20.115222 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e7399524-7ecf-4cb8-8277-ffff81f59d61 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:20.115821 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e7399524-7ecf-4cb8-8277-ffff81f59d61 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:20.182520 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e7399524-7ecf-4cb8-8277-ffff81f59d61 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:20.190803 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e7399524-7ecf-4cb8-8277-ffff81f59d61 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1218 microversion: 2.1 time: 0.090294 Aug 30 01:24:20.191387 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 384/766] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:20 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:21.219128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:21.221635 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:21.232538 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:21.233198 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:21.234031 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:21.235381 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:21.235930 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:21.236532 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:21.274046 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:21.274687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:21.275128 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:21.276115 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lazy-loading 'fault' on Instance uuid 68833d42-7eed-4b4c-b315-842b9c015dfd {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:24:21.321543 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76eba6f76f84c5cb006e079aa86157a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c19009d374769a0d5bd5a82acaaa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:21.330133 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-72b62ea7-7ba5-4e68-9e8e-c7fb74cb1dbe tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 200 len: 1177 microversion: 2.1 time: 0.120066 Aug 30 01:24:21.330703 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 383/767] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:21 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 1177 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:22.350632 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-46e6a844-a237-4a6e-899f-f0f92ae667cc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:22.351243 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-46e6a844-a237-4a6e-899f-f0f92ae667cc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] [instance: 68833d42-7eed-4b4c-b315-842b9c015dfd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:22.358425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46e6a844-a237-4a6e-899f-f0f92ae667cc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:22.358911 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46e6a844-a237-4a6e-899f-f0f92ae667cc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:22.359352 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46e6a844-a237-4a6e-899f-f0f92ae667cc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:22.360333 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46e6a844-a237-4a6e-899f-f0f92ae667cc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:22.360792 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46e6a844-a237-4a6e-899f-f0f92ae667cc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:22.361218 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-46e6a844-a237-4a6e-899f-f0f92ae667cc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:22.375240 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-46e6a844-a237-4a6e-899f-f0f92ae667cc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] HTTP exception thrown: Instance 68833d42-7eed-4b4c-b315-842b9c015dfd could not be found. Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-46e6a844-a237-4a6e-899f-f0f92ae667cc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Request method failure captured: Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd HTTP/1.1 Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWVvT9o_1krzHo3ja4fyqY0H91shwtYbL89l5DWPIG9lBd7tmeCoot_CaDh8239QF1ZuCgRNs3HRanILJhejKG8ydpQ_lgjOX5GWqCi326LWqnYZknOv3Ps-rKDnJAqbBp2ng4Hb50FwzFEFmhOEbRDi3CBCf5BXFTyzbKvJjwdqsCU Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: 089c19009d374769a0d5bd5a82acaaa7 Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-TestShelveInstance-1150326277 Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:24:22.376930 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:24:22.378568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/089c19009d374769a0d5bd5a82acaaa7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/089c19009d374769a0d5bd5a82acaaa7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/089c19009d374769a0d5bd5a82acaaa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_089c19009d374769a0d5bd5a82acaaa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:24:22.378568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-TestShelveInstance-1150326277 Aug 30 01:24:22.378568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 089c19009d374769a0d5bd5a82acaaa7 Aug 30 01:24:22.378568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-TestShelveInstance-1150326277 Aug 30 01:24:22.378568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-TestShelveInstance-1150326277-project Aug 30 01:24:22.378568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:24:22.378568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:24:22.378568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: e76eba6f76f84c5cb006e079aa86157a Aug 30 01:24:22.378568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-TestShelveInstance-1150326277-project Aug 30 01:24:22.378568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:24:22.378568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 68833d42-7eed-4b4c-b315-842b9c015dfd could not be found. Aug 30 01:24:22.378568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '68833d42-7eed-4b4c-b315-842b9c015dfd'} Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68833d42-7eed-4b4c-b315-842b9c015dfd could not be found. Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:24:22.379545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68833d42-7eed-4b4c-b315-842b9c015dfd could not be found. Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68833d42-7eed-4b4c-b315-842b9c015dfd could not be found. Aug 30 01:24:22.381096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:24:22.382527 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-46e6a844-a237-4a6e-899f-f0f92ae667cc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Returning 404 to user: Instance 68833d42-7eed-4b4c-b315-842b9c015dfd could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:24:22.382527 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-46e6a844-a237-4a6e-899f-f0f92ae667cc tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd" status: 404 len: 111 microversion: 2.1 time: 0.031575 Aug 30 01:24:22.382527 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 385/768] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:22 2022] GET /compute/v2.1/servers/68833d42-7eed-4b4c-b315-842b9c015dfd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:24:22.537016 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-008000ab-b680-4286-969e-6095b8f7cc51 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] Calling method '.version_select at 0x7ff48acd59d0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:22.557204 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-008000ab-b680-4286-969e-6095b8f7cc51 tempest-TestShelveInstance-1150326277 tempest-TestShelveInstance-1150326277-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-482259432" status: 202 len: 0 microversion: 2.1 time: 0.023947 Aug 30 01:24:22.557939 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 384/769] 10.222.0.44 () {58 vars in 1251 bytes} [Tue Aug 30 01:24:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-482259432 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:24:24.711250 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-37b9f35d-9972-461f-8be6-a70943b7a7a8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:24.712455 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-37b9f35d-9972-461f-8be6-a70943b7a7a8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:24.719932 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37b9f35d-9972-461f-8be6-a70943b7a7a8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:24.720452 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37b9f35d-9972-461f-8be6-a70943b7a7a8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:24.720920 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37b9f35d-9972-461f-8be6-a70943b7a7a8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:24.721624 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37b9f35d-9972-461f-8be6-a70943b7a7a8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:24.722082 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37b9f35d-9972-461f-8be6-a70943b7a7a8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:24.722511 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37b9f35d-9972-461f-8be6-a70943b7a7a8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:24.753581 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-37b9f35d-9972-461f-8be6-a70943b7a7a8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/os-volume_attachments/b9b9985b-0fc1-45b1-9470-625fc9e1084f" status: 200 len: 194 microversion: 2.20 time: 0.046394 Aug 30 01:24:24.754178 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 386/770] 10.222.0.44 () {60 vars in 1454 bytes} [Tue Aug 30 01:24:24 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/os-volume_attachments/b9b9985b-0fc1-45b1-9470-625fc9e1084f => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:24:24.830171 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6fe5f067-a192-4306-81f3-5f893cabef2f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:24.830812 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6fe5f067-a192-4306-81f3-5f893cabef2f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:24.836665 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fe5f067-a192-4306-81f3-5f893cabef2f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:24.837150 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fe5f067-a192-4306-81f3-5f893cabef2f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:24.837596 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fe5f067-a192-4306-81f3-5f893cabef2f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:24.838311 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fe5f067-a192-4306-81f3-5f893cabef2f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:24.838754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fe5f067-a192-4306-81f3-5f893cabef2f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:24.839175 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fe5f067-a192-4306-81f3-5f893cabef2f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:24.921322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-6fe5f067-a192-4306-81f3-5f893cabef2f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lazy-loading 'services' on Instance uuid 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:24:25.002818 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6fe5f067-a192-4306-81f3-5f893cabef2f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/os-volume_attachments/b9b9985b-0fc1-45b1-9470-625fc9e1084f" status: 202 len: 0 microversion: 2.20 time: 0.176988 Aug 30 01:24:25.003535 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 385/771] 10.222.0.44 () {60 vars in 1457 bytes} [Tue Aug 30 01:24:24 2022] DELETE /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/os-volume_attachments/b9b9985b-0fc1-45b1-9470-625fc9e1084f => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 01:24:25.012425 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fa6fd3b2-1bf4-4b89-8ced-3332e05a68ec tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:25.015175 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fa6fd3b2-1bf4-4b89-8ced-3332e05a68ec tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:25.022545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fa6fd3b2-1bf4-4b89-8ced-3332e05a68ec tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:25.023380 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fa6fd3b2-1bf4-4b89-8ced-3332e05a68ec tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:25.024123 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fa6fd3b2-1bf4-4b89-8ced-3332e05a68ec tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:25.025648 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fa6fd3b2-1bf4-4b89-8ced-3332e05a68ec tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:25.026884 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fa6fd3b2-1bf4-4b89-8ced-3332e05a68ec tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:25.027553 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fa6fd3b2-1bf4-4b89-8ced-3332e05a68ec tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:25.072698 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fa6fd3b2-1bf4-4b89-8ced-3332e05a68ec tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064372 Aug 30 01:24:25.077477 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 387/772] 10.222.0.44 () {60 vars in 1343 bytes} [Tue Aug 30 01:24:25 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:24:26.086469 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6b35a32b-503b-4915-9618-73b2d7d1cc74 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:26.090065 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6b35a32b-503b-4915-9618-73b2d7d1cc74 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:26.097054 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b35a32b-503b-4915-9618-73b2d7d1cc74 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:26.097535 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b35a32b-503b-4915-9618-73b2d7d1cc74 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:26.098165 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b35a32b-503b-4915-9618-73b2d7d1cc74 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:26.099038 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b35a32b-503b-4915-9618-73b2d7d1cc74 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:26.099491 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b35a32b-503b-4915-9618-73b2d7d1cc74 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:26.099917 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b35a32b-503b-4915-9618-73b2d7d1cc74 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:26.131170 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6b35a32b-503b-4915-9618-73b2d7d1cc74 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049631 Aug 30 01:24:26.131735 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 386/773] 10.222.0.44 () {60 vars in 1343 bytes} [Tue Aug 30 01:24:26 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:26.201371 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-78415127-0930-4da1-9cc3-8d6408cb5fc0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:26.201942 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-78415127-0930-4da1-9cc3-8d6408cb5fc0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:26.209268 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78415127-0930-4da1-9cc3-8d6408cb5fc0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:26.209748 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78415127-0930-4da1-9cc3-8d6408cb5fc0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:26.210180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78415127-0930-4da1-9cc3-8d6408cb5fc0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:26.210867 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78415127-0930-4da1-9cc3-8d6408cb5fc0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:26.211314 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78415127-0930-4da1-9cc3-8d6408cb5fc0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:26.211734 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78415127-0930-4da1-9cc3-8d6408cb5fc0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:26.242523 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-78415127-0930-4da1-9cc3-8d6408cb5fc0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:24:26.326471 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-78415127-0930-4da1-9cc3-8d6408cb5fc0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 204 len: 0 microversion: 2.20 time: 0.129286 Aug 30 01:24:26.327006 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 388/774] 10.222.0.44 () {60 vars in 1280 bytes} [Tue Aug 30 01:24:26 2022] DELETE /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 01:24:26.335491 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e7c54f33-77ae-437a-bcf7-885f57bf321d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:26.336143 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e7c54f33-77ae-437a-bcf7-885f57bf321d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:26.348059 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e7c54f33-77ae-437a-bcf7-885f57bf321d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:26.349289 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e7c54f33-77ae-437a-bcf7-885f57bf321d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:26.349797 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e7c54f33-77ae-437a-bcf7-885f57bf321d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:26.351606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e7c54f33-77ae-437a-bcf7-885f57bf321d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:26.352258 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e7c54f33-77ae-437a-bcf7-885f57bf321d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:26.352901 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e7c54f33-77ae-437a-bcf7-885f57bf321d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:26.561640 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e7c54f33-77ae-437a-bcf7-885f57bf321d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:26.570340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e7c54f33-77ae-437a-bcf7-885f57bf321d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:26.572397 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e7c54f33-77ae-437a-bcf7-885f57bf321d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:26.573775 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e7c54f33-77ae-437a-bcf7-885f57bf321d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1724 microversion: 2.20 time: 0.242279 Aug 30 01:24:26.574409 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 387/775] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:26 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:27.599856 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8c5748c9-9992-48e4-a44c-19c775219595 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:27.601220 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8c5748c9-9992-48e4-a44c-19c775219595 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:27.608476 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:27.611102 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8c5748c9-9992-48e4-a44c-19c775219595 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:27.611966 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8c5748c9-9992-48e4-a44c-19c775219595 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:27.612745 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8c5748c9-9992-48e4-a44c-19c775219595 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:27.613734 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8c5748c9-9992-48e4-a44c-19c775219595 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:27.614389 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8c5748c9-9992-48e4-a44c-19c775219595 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:27.615011 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8c5748c9-9992-48e4-a44c-19c775219595 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:27.769188 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8c5748c9-9992-48e4-a44c-19c775219595 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:27.778493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8c5748c9-9992-48e4-a44c-19c775219595 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:27.779952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8c5748c9-9992-48e4-a44c-19c775219595 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:27.781168 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8c5748c9-9992-48e4-a44c-19c775219595 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1724 microversion: 2.20 time: 0.186049 Aug 30 01:24:27.781725 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 389/776] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:27 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:28.804515 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-eca504d9-a01f-43d9-b64a-8d477af0188a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:28.805100 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-eca504d9-a01f-43d9-b64a-8d477af0188a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:28.815946 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eca504d9-a01f-43d9-b64a-8d477af0188a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:28.816579 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eca504d9-a01f-43d9-b64a-8d477af0188a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:28.817090 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eca504d9-a01f-43d9-b64a-8d477af0188a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:28.817916 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eca504d9-a01f-43d9-b64a-8d477af0188a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:28.819233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eca504d9-a01f-43d9-b64a-8d477af0188a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:28.819770 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-eca504d9-a01f-43d9-b64a-8d477af0188a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:28.969006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-eca504d9-a01f-43d9-b64a-8d477af0188a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:28.981810 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-eca504d9-a01f-43d9-b64a-8d477af0188a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:28.983470 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-eca504d9-a01f-43d9-b64a-8d477af0188a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:28.985215 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-eca504d9-a01f-43d9-b64a-8d477af0188a tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1657 microversion: 2.20 time: 0.185059 Aug 30 01:24:29.003115 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 388/777] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:28 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1657 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:29.333049 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-a392a761-a8bd-46a5-8ace-f263e2947dcc req-ee2c3fc0-079a-44b7-90d6-d2e9f90aa847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa5b2d0-a841-4330-998e-ecb58b4ef9f3", "name": "network-vif-deleted", "tag": "4ccc2f03-e4d5-41df-ae6e-d6c35f2a9ef3"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:29.346324 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a392a761-a8bd-46a5-8ace-f263e2947dcc req-ee2c3fc0-079a-44b7-90d6-d2e9f90aa847 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:29.346797 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a392a761-a8bd-46a5-8ace-f263e2947dcc req-ee2c3fc0-079a-44b7-90d6-d2e9f90aa847 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:29.347218 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a392a761-a8bd-46a5-8ace-f263e2947dcc req-ee2c3fc0-079a-44b7-90d6-d2e9f90aa847 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:29.362185 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-a392a761-a8bd-46a5-8ace-f263e2947dcc req-ee2c3fc0-079a-44b7-90d6-d2e9f90aa847 service nova] Creating event network-vif-deleted:4ccc2f03-e4d5-41df-ae6e-d6c35f2a9ef3 for instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 on hv-cinder-81514 Aug 30 01:24:29.388524 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-a392a761-a8bd-46a5-8ace-f263e2947dcc req-ee2c3fc0-079a-44b7-90d6-d2e9f90aa847 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058955 Aug 30 01:24:29.392175 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 390/778] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:30.010727 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:30.021528 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:30.033032 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:30.033810 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:30.034561 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:30.035487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:30.036313 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:30.037070 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:30.063849 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:30.101399 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:30.102234 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:30.103235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:30.103864 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lazy-loading 'fault' on Instance uuid 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:24:30.163125 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:30.177560 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:30.179082 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:30.180322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c3731f1d-a83f-47c2-bcf2-fe106e12e361 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 200 len: 1371 microversion: 2.20 time: 0.175735 Aug 30 01:24:30.180974 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 389/779] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:30 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:31.204955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-25bbfa6d-97a2-4aa2-8eb0-b51a1af4311e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:31.205656 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-25bbfa6d-97a2-4aa2-8eb0-b51a1af4311e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:31.211820 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-25bbfa6d-97a2-4aa2-8eb0-b51a1af4311e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:31.212423 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-25bbfa6d-97a2-4aa2-8eb0-b51a1af4311e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:31.213017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-25bbfa6d-97a2-4aa2-8eb0-b51a1af4311e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:31.213712 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-25bbfa6d-97a2-4aa2-8eb0-b51a1af4311e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:31.214181 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-25bbfa6d-97a2-4aa2-8eb0-b51a1af4311e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:31.214607 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-25bbfa6d-97a2-4aa2-8eb0-b51a1af4311e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:31.228948 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-25bbfa6d-97a2-4aa2-8eb0-b51a1af4311e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] HTTP exception thrown: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-25bbfa6d-97a2-4aa2-8eb0-b51a1af4311e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Request method failure captured: Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 HTTP/1.1 Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWY4Ajr1SHvjTvYB1tIwdBkhWriM__geK0tOaMrq7JCyTkPk0MHO_YmWxf20UItyW7_qwvTmot3mLAHLiHU1_DBPq1CXMeS3-e2q0Cm5f8dUVolW_hQSrMhOnHSkEpJ1Va5tRh6mAHJBHtyzFrp2cUK6_rHHi2j_1rOqbWRK4ag7TFs Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: 5d08b735ca4249309f4ecd40cbacd537 Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:24:31.230590 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:24:31.232317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:24:31.232317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:24:31.232317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 5d08b735ca4249309f4ecd40cbacd537 Aug 30 01:24:31.232317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:24:31.232317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeShelveTestJSON-4862544-project Aug 30 01:24:31.232317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:24:31.232317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:24:31.232317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 22bf08f4cdb24731bf00c7962bf81c40 Aug 30 01:24:31.232317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeShelveTestJSON-4862544-project Aug 30 01:24:31.232317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:24:31.232317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:24:31.232317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '7fa5b2d0-a841-4330-998e-ecb58b4ef9f3'} Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:24:31.233237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:24:31.235017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:24:31.236443 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-25bbfa6d-97a2-4aa2-8eb0-b51a1af4311e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Returning 404 to user: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:24:31.236443 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-25bbfa6d-97a2-4aa2-8eb0-b51a1af4311e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 404 len: 111 microversion: 2.20 time: 0.031977 Aug 30 01:24:31.236443 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 391/780] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:31 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:24:31.241459 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-187a23bb-6aa9-4230-8474-d326bd28930f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '.version_select at 0x7ff48ac770d0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:31.261468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-187a23bb-6aa9-4230-8474-d326bd28930f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208070486" status: 204 len: 0 microversion: 2.20 time: 0.023921 Aug 30 01:24:31.262031 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 390/781] 10.222.0.44 () {60 vars in 1259 bytes} [Tue Aug 30 01:24:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208070486 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 01:24:31.885149 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7d0f56b9-f1bd-406b-83da-60c492c2a1de tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Action: 'create', calling method: .version_select at 0x7ff48ae01160>, body: {"keypair": {"name": "tempest-keypair-1550608156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDlYybiTQabL9yvLq3kyP/+9xtVplNceOByy+iCorpD6bcUAxhvnTbEWK72W7iz3KRI4oLdEQFxfQIo6aCwKXTRgD/NEEYqaTA6TmZH3KzqIcXIE4GKTHg8lEK2ildZSg=="}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:31.900507 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-7d0f56b9-f1bd-406b-83da-60c492c2a1de tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Getting quotas for project 5d08b735ca4249309f4ecd40cbacd537. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:24:31.904296 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-7d0f56b9-f1bd-406b-83da-60c492c2a1de tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Getting quotas for user 22bf08f4cdb24731bf00c7962bf81c40 and project 5d08b735ca4249309f4ecd40cbacd537. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:24:31.926157 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7d0f56b9-f1bd-406b-83da-60c492c2a1de tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045481 Aug 30 01:24:31.926743 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 392/782] 10.222.0.44 () {62 vars in 1200 bytes} [Tue Aug 30 01:24:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 01:24:33.215235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-720213106", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7931701-abc1-4317-a5b8-4bc0c704b8a3"}], "security_groups": [{"name": "tempest-securitygroup--142125735"}], "key_name": "tempest-keypair-1550608156", "user_data": "}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:33.319471 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] validate_networks() for [('d7931701-abc1-4317-a5b8-4bc0c704b8a3', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:24:33.700292 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:24:33.700712 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:24:33.701184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:24:33.701626 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:24:33.702035 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:24:33.711206 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:33.711684 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:33.712177 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:33.712891 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:33.714165 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:33.714402 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:33.731526 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Getting quotas for project 5d08b735ca4249309f4ecd40cbacd537. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:24:33.735737 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Getting quotas for user 22bf08f4cdb24731bf00c7962bf81c40 and project 5d08b735ca4249309f4ecd40cbacd537. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:24:33.747308 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:24:33.749655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:24:33.797678 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5835f4f4-370d-4fc4-b2e5-78b8a11d2536 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.587315 Aug 30 01:24:33.798622 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 391/783] 10.222.0.44 () {62 vars in 1188 bytes} [Tue Aug 30 01:24:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 01:24:33.810599 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0a3e5698-6215-43da-b0a9-f052df24ea86 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:33.811203 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0a3e5698-6215-43da-b0a9-f052df24ea86 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:33.869951 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0a3e5698-6215-43da-b0a9-f052df24ea86 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:33.877505 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0a3e5698-6215-43da-b0a9-f052df24ea86 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:33.879095 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0a3e5698-6215-43da-b0a9-f052df24ea86 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:33.880223 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0a3e5698-6215-43da-b0a9-f052df24ea86 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1281 microversion: 2.20 time: 0.074115 Aug 30 01:24:33.880774 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 393/784] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:33 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:34.903364 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-320df9ca-2113-4ea2-8ab1-a5e8b53699c8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:34.904118 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-320df9ca-2113-4ea2-8ab1-a5e8b53699c8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:34.906396 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:34.913840 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-320df9ca-2113-4ea2-8ab1-a5e8b53699c8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:34.914605 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-320df9ca-2113-4ea2-8ab1-a5e8b53699c8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:34.915046 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-320df9ca-2113-4ea2-8ab1-a5e8b53699c8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:34.915768 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-320df9ca-2113-4ea2-8ab1-a5e8b53699c8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:34.917054 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-320df9ca-2113-4ea2-8ab1-a5e8b53699c8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:34.917673 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-320df9ca-2113-4ea2-8ab1-a5e8b53699c8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:34.997301 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-320df9ca-2113-4ea2-8ab1-a5e8b53699c8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:35.007477 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-320df9ca-2113-4ea2-8ab1-a5e8b53699c8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:35.009249 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-320df9ca-2113-4ea2-8ab1-a5e8b53699c8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:35.011745 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-320df9ca-2113-4ea2-8ab1-a5e8b53699c8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1333 microversion: 2.20 time: 0.112703 Aug 30 01:24:35.013333 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 392/785] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:34 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1333 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:36.035969 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2ac7af04-36f1-474c-ac8c-08137d59410f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:36.036726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2ac7af04-36f1-474c-ac8c-08137d59410f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:36.043612 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ac7af04-36f1-474c-ac8c-08137d59410f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:36.045177 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ac7af04-36f1-474c-ac8c-08137d59410f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:36.045626 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ac7af04-36f1-474c-ac8c-08137d59410f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:36.046328 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ac7af04-36f1-474c-ac8c-08137d59410f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:36.046823 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ac7af04-36f1-474c-ac8c-08137d59410f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:36.047248 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ac7af04-36f1-474c-ac8c-08137d59410f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:36.257439 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2ac7af04-36f1-474c-ac8c-08137d59410f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:36.265758 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2ac7af04-36f1-474c-ac8c-08137d59410f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:36.267204 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2ac7af04-36f1-474c-ac8c-08137d59410f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:36.268348 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2ac7af04-36f1-474c-ac8c-08137d59410f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1406 microversion: 2.20 time: 0.236539 Aug 30 01:24:36.268905 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 394/786] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:36 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:36.533399 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-e3d1bdf0-7ced-47a3-b10f-162fe14e4735 req-376c235b-dbff-42e8-8610-6c3f9a42284b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8722e41f-fb01-458b-b5c7-debe9132c196", "tag": "c49d906b-0426-46ea-a3fc-7b2c2024e265"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:36.544901 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-e3d1bdf0-7ced-47a3-b10f-162fe14e4735 req-376c235b-dbff-42e8-8610-6c3f9a42284b service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:36.545481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-e3d1bdf0-7ced-47a3-b10f-162fe14e4735 req-376c235b-dbff-42e8-8610-6c3f9a42284b service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:36.545982 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-e3d1bdf0-7ced-47a3-b10f-162fe14e4735 req-376c235b-dbff-42e8-8610-6c3f9a42284b service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:36.558231 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-e3d1bdf0-7ced-47a3-b10f-162fe14e4735 req-376c235b-dbff-42e8-8610-6c3f9a42284b service nova] Creating event network-changed:c49d906b-0426-46ea-a3fc-7b2c2024e265 for instance 8722e41f-fb01-458b-b5c7-debe9132c196 on hv-cinder-81514 Aug 30 01:24:36.563114 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-e3d1bdf0-7ced-47a3-b10f-162fe14e4735 req-376c235b-dbff-42e8-8610-6c3f9a42284b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033500 Aug 30 01:24:36.581747 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 393/787] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:37.293263 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-76d381ed-5b2e-45e7-9743-586e33837193 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:37.293874 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-76d381ed-5b2e-45e7-9743-586e33837193 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:37.300219 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76d381ed-5b2e-45e7-9743-586e33837193 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:37.300701 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76d381ed-5b2e-45e7-9743-586e33837193 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:37.301133 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76d381ed-5b2e-45e7-9743-586e33837193 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:37.301821 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76d381ed-5b2e-45e7-9743-586e33837193 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:37.302274 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76d381ed-5b2e-45e7-9743-586e33837193 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:37.302695 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-76d381ed-5b2e-45e7-9743-586e33837193 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:37.307125 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:37.435657 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-76d381ed-5b2e-45e7-9743-586e33837193 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:37.443652 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-76d381ed-5b2e-45e7-9743-586e33837193 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:37.445136 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-76d381ed-5b2e-45e7-9743-586e33837193 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:37.446242 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-76d381ed-5b2e-45e7-9743-586e33837193 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1406 microversion: 2.20 time: 0.157672 Aug 30 01:24:37.446798 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 395/788] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:37 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:38.470943 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b12dca2e-0ae1-4b34-9f93-78805036f43b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:38.471642 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b12dca2e-0ae1-4b34-9f93-78805036f43b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:38.477866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b12dca2e-0ae1-4b34-9f93-78805036f43b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:38.478967 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b12dca2e-0ae1-4b34-9f93-78805036f43b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:38.479464 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b12dca2e-0ae1-4b34-9f93-78805036f43b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:38.480195 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b12dca2e-0ae1-4b34-9f93-78805036f43b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:38.480650 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b12dca2e-0ae1-4b34-9f93-78805036f43b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:38.481075 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b12dca2e-0ae1-4b34-9f93-78805036f43b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:38.612503 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b12dca2e-0ae1-4b34-9f93-78805036f43b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:38.621337 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b12dca2e-0ae1-4b34-9f93-78805036f43b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:38.622811 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b12dca2e-0ae1-4b34-9f93-78805036f43b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:38.623911 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b12dca2e-0ae1-4b34-9f93-78805036f43b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1406 microversion: 2.20 time: 0.157736 Aug 30 01:24:38.624504 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 394/789] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:38 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:39.646722 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b86bb79b-eb9a-481f-b60e-8bd968b6243d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:39.647344 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b86bb79b-eb9a-481f-b60e-8bd968b6243d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:39.655409 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b86bb79b-eb9a-481f-b60e-8bd968b6243d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:39.656076 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b86bb79b-eb9a-481f-b60e-8bd968b6243d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:39.656534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b86bb79b-eb9a-481f-b60e-8bd968b6243d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:39.657231 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b86bb79b-eb9a-481f-b60e-8bd968b6243d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:39.657681 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b86bb79b-eb9a-481f-b60e-8bd968b6243d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:39.658098 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b86bb79b-eb9a-481f-b60e-8bd968b6243d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:39.795543 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b86bb79b-eb9a-481f-b60e-8bd968b6243d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:39.804111 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b86bb79b-eb9a-481f-b60e-8bd968b6243d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:39.805734 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b86bb79b-eb9a-481f-b60e-8bd968b6243d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:39.807380 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b86bb79b-eb9a-481f-b60e-8bd968b6243d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1406 microversion: 2.20 time: 0.164589 Aug 30 01:24:39.807946 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 396/790] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:39 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:40.830974 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dd99eda8-736a-40a8-86ed-c2e801aea5e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:40.831506 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-dd99eda8-736a-40a8-86ed-c2e801aea5e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:40.838726 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd99eda8-736a-40a8-86ed-c2e801aea5e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:40.839203 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd99eda8-736a-40a8-86ed-c2e801aea5e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:40.839638 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd99eda8-736a-40a8-86ed-c2e801aea5e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:40.840363 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd99eda8-736a-40a8-86ed-c2e801aea5e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:40.840821 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd99eda8-736a-40a8-86ed-c2e801aea5e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:40.841247 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dd99eda8-736a-40a8-86ed-c2e801aea5e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:40.986718 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dd99eda8-736a-40a8-86ed-c2e801aea5e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:40.995335 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dd99eda8-736a-40a8-86ed-c2e801aea5e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:40.996817 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dd99eda8-736a-40a8-86ed-c2e801aea5e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:40.997931 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dd99eda8-736a-40a8-86ed-c2e801aea5e6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1406 microversion: 2.20 time: 0.170937 Aug 30 01:24:40.998518 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 395/791] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:40 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:41.774413 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-d17bbb0f-bb41-4735-bee0-4b3f8822e5b1 req-e30f7b91-6441-4370-9e80-23af5d366034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8722e41f-fb01-458b-b5c7-debe9132c196", "name": "network-vif-plugged", "status": "completed", "tag": "c49d906b-0426-46ea-a3fc-7b2c2024e265"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:41.785595 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-d17bbb0f-bb41-4735-bee0-4b3f8822e5b1 req-e30f7b91-6441-4370-9e80-23af5d366034 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:41.786059 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-d17bbb0f-bb41-4735-bee0-4b3f8822e5b1 req-e30f7b91-6441-4370-9e80-23af5d366034 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:41.786488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-d17bbb0f-bb41-4735-bee0-4b3f8822e5b1 req-e30f7b91-6441-4370-9e80-23af5d366034 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:41.798437 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-d17bbb0f-bb41-4735-bee0-4b3f8822e5b1 req-e30f7b91-6441-4370-9e80-23af5d366034 service nova] Creating event network-vif-plugged:c49d906b-0426-46ea-a3fc-7b2c2024e265 for instance 8722e41f-fb01-458b-b5c7-debe9132c196 on hv-cinder-81514 Aug 30 01:24:41.803516 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-d17bbb0f-bb41-4735-bee0-4b3f8822e5b1 req-e30f7b91-6441-4370-9e80-23af5d366034 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032725 Aug 30 01:24:41.804153 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 397/792] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:42.021363 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-89e767cd-d89a-4000-baff-1d4512620db9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:42.022151 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-89e767cd-d89a-4000-baff-1d4512620db9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:42.028990 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-89e767cd-d89a-4000-baff-1d4512620db9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:42.029477 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-89e767cd-d89a-4000-baff-1d4512620db9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:42.029918 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-89e767cd-d89a-4000-baff-1d4512620db9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:42.030619 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-89e767cd-d89a-4000-baff-1d4512620db9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:42.031210 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-89e767cd-d89a-4000-baff-1d4512620db9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:42.031505 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-89e767cd-d89a-4000-baff-1d4512620db9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:42.165408 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-89e767cd-d89a-4000-baff-1d4512620db9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:42.174474 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-89e767cd-d89a-4000-baff-1d4512620db9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:42.175895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-89e767cd-d89a-4000-baff-1d4512620db9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:42.177047 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-89e767cd-d89a-4000-baff-1d4512620db9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1406 microversion: 2.20 time: 0.159659 Aug 30 01:24:42.177599 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 396/793] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:42 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:43.200108 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3c6777f3-190f-4f0c-a07e-e4c282e75351 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:43.200816 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3c6777f3-190f-4f0c-a07e-e4c282e75351 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:43.207418 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c6777f3-190f-4f0c-a07e-e4c282e75351 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:43.207901 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c6777f3-190f-4f0c-a07e-e4c282e75351 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:43.208363 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c6777f3-190f-4f0c-a07e-e4c282e75351 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:43.209055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c6777f3-190f-4f0c-a07e-e4c282e75351 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:43.209506 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c6777f3-190f-4f0c-a07e-e4c282e75351 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:43.210003 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c6777f3-190f-4f0c-a07e-e4c282e75351 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:43.349304 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3c6777f3-190f-4f0c-a07e-e4c282e75351 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:43.358664 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3c6777f3-190f-4f0c-a07e-e4c282e75351 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:43.360127 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3c6777f3-190f-4f0c-a07e-e4c282e75351 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:43.361243 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3c6777f3-190f-4f0c-a07e-e4c282e75351 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1406 microversion: 2.20 time: 0.166156 Aug 30 01:24:43.361812 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 398/794] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:43 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:44.385081 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c926f80e-2c00-412a-9075-8e3221d08ff8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:44.385620 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c926f80e-2c00-412a-9075-8e3221d08ff8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:44.388069 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:44.388733 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:44.394782 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c926f80e-2c00-412a-9075-8e3221d08ff8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:44.395266 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c926f80e-2c00-412a-9075-8e3221d08ff8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:44.395701 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c926f80e-2c00-412a-9075-8e3221d08ff8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:44.396416 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c926f80e-2c00-412a-9075-8e3221d08ff8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:44.396869 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c926f80e-2c00-412a-9075-8e3221d08ff8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:44.397291 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c926f80e-2c00-412a-9075-8e3221d08ff8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:44.526639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c926f80e-2c00-412a-9075-8e3221d08ff8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:44.534685 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c926f80e-2c00-412a-9075-8e3221d08ff8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:44.536153 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c926f80e-2c00-412a-9075-8e3221d08ff8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:44.537309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c926f80e-2c00-412a-9075-8e3221d08ff8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1598 microversion: 2.20 time: 0.156276 Aug 30 01:24:44.537882 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 397/795] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:24:44 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:24:44.559612 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9df5d3fb-2ca7-4b66-b2e3-1d299fdc0745 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:44.560168 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9df5d3fb-2ca7-4b66-b2e3-1d299fdc0745 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:44.562054 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:44.567657 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9df5d3fb-2ca7-4b66-b2e3-1d299fdc0745 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:44.568167 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9df5d3fb-2ca7-4b66-b2e3-1d299fdc0745 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:44.568602 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9df5d3fb-2ca7-4b66-b2e3-1d299fdc0745 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:44.569683 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9df5d3fb-2ca7-4b66-b2e3-1d299fdc0745 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:44.569803 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9df5d3fb-2ca7-4b66-b2e3-1d299fdc0745 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:44.570139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9df5d3fb-2ca7-4b66-b2e3-1d299fdc0745 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:44.649318 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9df5d3fb-2ca7-4b66-b2e3-1d299fdc0745 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093637 Aug 30 01:24:44.650014 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 399/796] 10.222.0.44 () {60 vars in 1316 bytes} [Tue Aug 30 01:24:44 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:24:45.584391 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-24cc092e-f875-497d-920d-5396167e9325 req-376ef3b9-af9c-4a06-b5fe-07a68da7e68d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8722e41f-fb01-458b-b5c7-debe9132c196", "tag": "c49d906b-0426-46ea-a3fc-7b2c2024e265"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:45.594935 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-24cc092e-f875-497d-920d-5396167e9325 req-376ef3b9-af9c-4a06-b5fe-07a68da7e68d service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:45.595500 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-24cc092e-f875-497d-920d-5396167e9325 req-376ef3b9-af9c-4a06-b5fe-07a68da7e68d service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:45.596214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-24cc092e-f875-497d-920d-5396167e9325 req-376ef3b9-af9c-4a06-b5fe-07a68da7e68d service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:45.608519 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-24cc092e-f875-497d-920d-5396167e9325 req-376ef3b9-af9c-4a06-b5fe-07a68da7e68d service nova] Creating event network-changed:c49d906b-0426-46ea-a3fc-7b2c2024e265 for instance 8722e41f-fb01-458b-b5c7-debe9132c196 on hv-cinder-81514 Aug 30 01:24:45.613611 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-24cc092e-f875-497d-920d-5396167e9325 req-376ef3b9-af9c-4a06-b5fe-07a68da7e68d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032933 Aug 30 01:24:45.614212 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 398/797] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:55.973621 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:55.974527 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=23 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:55.979002 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5875bc3f-d069-4237-88eb-8fb7b72625a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:55.979493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5875bc3f-d069-4237-88eb-8fb7b72625a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:55.986846 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5875bc3f-d069-4237-88eb-8fb7b72625a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:55.987332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5875bc3f-d069-4237-88eb-8fb7b72625a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:55.987774 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5875bc3f-d069-4237-88eb-8fb7b72625a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:55.988529 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5875bc3f-d069-4237-88eb-8fb7b72625a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:55.988986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5875bc3f-d069-4237-88eb-8fb7b72625a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:55.989414 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5875bc3f-d069-4237-88eb-8fb7b72625a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:56.013608 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5875bc3f-d069-4237-88eb-8fb7b72625a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1/ips" status: 200 len: 151 microversion: 2.1 time: 0.041343 Aug 30 01:24:56.014174 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 400/798] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Aug 30 01:24:55 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:56.023188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=13 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:56.024017 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=40 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:56.029499 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0aeb49ce-59fb-47e3-bf54-6dde9620e67a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dd0eea5-bc74-4e7b-aaa7-1c3fc3c9affd"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:56.031850 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0aeb49ce-59fb-47e3-bf54-6dde9620e67a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:56.038854 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0aeb49ce-59fb-47e3-bf54-6dde9620e67a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:56.039331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0aeb49ce-59fb-47e3-bf54-6dde9620e67a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:56.039765 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0aeb49ce-59fb-47e3-bf54-6dde9620e67a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:56.040794 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0aeb49ce-59fb-47e3-bf54-6dde9620e67a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:56.041313 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0aeb49ce-59fb-47e3-bf54-6dde9620e67a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:56.041738 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0aeb49ce-59fb-47e3-bf54-6dde9620e67a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:56.122799 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-0aeb49ce-59fb-47e3-bf54-6dde9620e67a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Invalid volume: volume 3dd0eea5-bc74-4e7b-aaa7-1c3fc3c9affd is already attached to instances: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0aeb49ce-59fb-47e3-bf54-6dde9620e67a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: POST /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1/os-volume_attachments HTTP/1.1 Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 74 Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:24:56.124594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:24:56.125998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:24:56.125998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:24:56.125998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:24:56.125998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:24:56.125998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:24:56.125998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:24:56.125998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:24:56.125998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:24:56.125998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:24:56.125998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Aug 30 01:24:56.125998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {"volumeAttachment": {"volumeId": "3dd0eea5-bc74-4e7b-aaa7-1c3fc3c9affd"}} Aug 30 01:24:56.125998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Invalid volume: volume 3dd0eea5-bc74-4e7b-aaa7-1c3fc3c9affd is already attached to instances: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'server_id': '1f305831-eafb-4667-a621-cb2bf89c07c1', 'body': {'volumeAttachment': {'volumeId': '3dd0eea5-bc74-4e7b-aaa7-1c3fc3c9affd'}}} Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3dd0eea5-bc74-4e7b-aaa7-1c3fc3c9affd is already attached to instances: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:24:56.126876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3dd0eea5-bc74-4e7b-aaa7-1c3fc3c9affd is already attached to instances: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:24:56.128245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:24:56.129543 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:24:56.129543 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:24:56.129543 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:24:56.129543 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3dd0eea5-bc74-4e7b-aaa7-1c3fc3c9affd is already attached to instances: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 Aug 30 01:24:56.129543 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:24:56.129543 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0aeb49ce-59fb-47e3-bf54-6dde9620e67a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 400 to user: Invalid volume: volume 3dd0eea5-bc74-4e7b-aaa7-1c3fc3c9affd is already attached to instances: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:24:56.129543 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0aeb49ce-59fb-47e3-bf54-6dde9620e67a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "POST /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104425 Aug 30 01:24:56.129543 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 399/799] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:24:56 2022] POST /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:24:56.135356 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cb349958-1762-4b44-93c5-a9aec28f0ac6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:56.135852 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cb349958-1762-4b44-93c5-a9aec28f0ac6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:56.142152 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb349958-1762-4b44-93c5-a9aec28f0ac6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:56.142638 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb349958-1762-4b44-93c5-a9aec28f0ac6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:56.143076 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb349958-1762-4b44-93c5-a9aec28f0ac6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:56.143767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb349958-1762-4b44-93c5-a9aec28f0ac6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:56.144249 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb349958-1762-4b44-93c5-a9aec28f0ac6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:56.144677 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb349958-1762-4b44-93c5-a9aec28f0ac6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:56.170822 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cb349958-1762-4b44-93c5-a9aec28f0ac6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:24:56.248584 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cb349958-1762-4b44-93c5-a9aec28f0ac6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 204 len: 0 microversion: 2.1 time: 0.117281 Aug 30 01:24:56.249172 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 401/800] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:24:56 2022] DELETE /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:24:56.257390 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-257e4836-c972-43bc-baee-3f908269f078 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:56.258029 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-257e4836-c972-43bc-baee-3f908269f078 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:56.265900 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-257e4836-c972-43bc-baee-3f908269f078 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:56.266378 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-257e4836-c972-43bc-baee-3f908269f078 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:56.266808 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-257e4836-c972-43bc-baee-3f908269f078 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:56.267489 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-257e4836-c972-43bc-baee-3f908269f078 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:56.267933 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-257e4836-c972-43bc-baee-3f908269f078 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:56.268387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-257e4836-c972-43bc-baee-3f908269f078 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:56.402594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-257e4836-c972-43bc-baee-3f908269f078 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:56.410426 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-257e4836-c972-43bc-baee-3f908269f078 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1684 microversion: 2.1 time: 0.156853 Aug 30 01:24:56.410998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 400/801] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:56 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:56.873347 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-290293364", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-799326755", "security_groups": [{"name": "tempest-secgroup-smoke-1498413457"}], "block_device_mapping_v2": [{"uuid": "4db66a5c-6c75-40a4-998e-9b1f38d992ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "12ed87b9-c5b4-42d2-a401-f5a13e16f9c3"}]}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:56.985125 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] validate_networks() for [('12ed87b9-c5b4-42d2-a401-f5a13e16f9c3', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:24:57.366219 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:24:57.366642 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:24:57.367116 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:24:57.367526 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:24:57.368632 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:24:57.377633 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:57.378114 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:57.378549 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:57.379262 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:57.379714 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:57.380172 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:57.397390 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Getting quotas for project 20cdcff29a0448dc92460b2ddd45617b. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:24:57.401408 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Getting quotas for user 2839103f52324a1ab1ebd43fe230addc and project 20cdcff29a0448dc92460b2ddd45617b. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:24:57.432975 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c7ce2412-7e4d-4f61-9217-e5ec8c8307b5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:57.433588 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c7ce2412-7e4d-4f61-9217-e5ec8c8307b5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:57.440106 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7ce2412-7e4d-4f61-9217-e5ec8c8307b5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:57.440595 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7ce2412-7e4d-4f61-9217-e5ec8c8307b5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:57.441030 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7ce2412-7e4d-4f61-9217-e5ec8c8307b5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:57.441730 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7ce2412-7e4d-4f61-9217-e5ec8c8307b5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:57.442188 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7ce2412-7e4d-4f61-9217-e5ec8c8307b5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:57.442602 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7ce2412-7e4d-4f61-9217-e5ec8c8307b5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:57.460414 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:24:57.463424 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4db66a5c-6c75-40a4-998e-9b1f38d992ea',volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:24:57.582365 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c7ce2412-7e4d-4f61-9217-e5ec8c8307b5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:57.590753 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c7ce2412-7e4d-4f61-9217-e5ec8c8307b5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1684 microversion: 2.1 time: 0.161586 Aug 30 01:24:57.591532 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 401/802] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:57 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:24:57.599329 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3be768e2-eaad-48d9-b1d9-b37da0d54f88 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730088 Aug 30 01:24:57.600129 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 402/803] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:24:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:24:57.611986 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ee5e5247-d17a-471e-91a8-c7869e3d6923 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:57.612639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ee5e5247-d17a-471e-91a8-c7869e3d6923 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:57.669748 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ee5e5247-d17a-471e-91a8-c7869e3d6923 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:57.677063 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ee5e5247-d17a-471e-91a8-c7869e3d6923 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1093 microversion: 2.1 time: 0.068987 Aug 30 01:24:57.677645 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 402/804] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:57 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:58.616822 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7f85f459-b04f-40b5-9776-d02db2e5f3b2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:58.618598 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7f85f459-b04f-40b5-9776-d02db2e5f3b2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:58.631497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7f85f459-b04f-40b5-9776-d02db2e5f3b2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:58.632598 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7f85f459-b04f-40b5-9776-d02db2e5f3b2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:58.634167 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7f85f459-b04f-40b5-9776-d02db2e5f3b2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:58.635560 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7f85f459-b04f-40b5-9776-d02db2e5f3b2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:58.636571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7f85f459-b04f-40b5-9776-d02db2e5f3b2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:58.637490 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7f85f459-b04f-40b5-9776-d02db2e5f3b2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:58.702066 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-30ae3798-0239-4369-86a1-7c2247f84df9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:58.702787 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-30ae3798-0239-4369-86a1-7c2247f84df9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:58.710705 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-30ae3798-0239-4369-86a1-7c2247f84df9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:58.711293 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-30ae3798-0239-4369-86a1-7c2247f84df9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:58.711871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-30ae3798-0239-4369-86a1-7c2247f84df9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:58.712695 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-30ae3798-0239-4369-86a1-7c2247f84df9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:58.713377 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-30ae3798-0239-4369-86a1-7c2247f84df9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:58.714008 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-30ae3798-0239-4369-86a1-7c2247f84df9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:58.772645 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7f85f459-b04f-40b5-9776-d02db2e5f3b2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:58.783785 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7f85f459-b04f-40b5-9776-d02db2e5f3b2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1616 microversion: 2.1 time: 0.173839 Aug 30 01:24:58.785511 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 403/805] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:58 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1616 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:58.802006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-30ae3798-0239-4369-86a1-7c2247f84df9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:58.811303 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-30ae3798-0239-4369-86a1-7c2247f84df9 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1191 microversion: 2.1 time: 0.115402 Aug 30 01:24:58.812013 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 403/806] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:58 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1191 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:24:59.048478 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-0ac0673a-3158-401e-9798-7d2145bb40e1 req-d8957e79-0113-4e2c-b51f-bd5cdf643dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f305831-eafb-4667-a621-cb2bf89c07c1", "name": "network-vif-deleted", "tag": "a39b7371-7db0-4120-85ff-91de9d57b615"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:59.057932 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0ac0673a-3158-401e-9798-7d2145bb40e1 req-d8957e79-0113-4e2c-b51f-bd5cdf643dfa service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:59.058416 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0ac0673a-3158-401e-9798-7d2145bb40e1 req-d8957e79-0113-4e2c-b51f-bd5cdf643dfa service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:59.058845 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0ac0673a-3158-401e-9798-7d2145bb40e1 req-d8957e79-0113-4e2c-b51f-bd5cdf643dfa service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:59.069846 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-0ac0673a-3158-401e-9798-7d2145bb40e1 req-d8957e79-0113-4e2c-b51f-bd5cdf643dfa service nova] Creating event network-vif-deleted:a39b7371-7db0-4120-85ff-91de9d57b615 for instance 1f305831-eafb-4667-a621-cb2bf89c07c1 on hv-cinder-81514 Aug 30 01:24:59.075218 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-0ac0673a-3158-401e-9798-7d2145bb40e1 req-d8957e79-0113-4e2c-b51f-bd5cdf643dfa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030362 Aug 30 01:24:59.075817 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 404/807] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:59.806898 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:59.808490 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:59.816991 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:59.817540 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:59.817985 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:59.818971 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:59.819622 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:59.820766 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:59.837640 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ca016349-1fc3-4b73-be22-519ce9f2fd4a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:59.838640 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ca016349-1fc3-4b73-be22-519ce9f2fd4a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:59.845676 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca016349-1fc3-4b73-be22-519ce9f2fd4a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:59.846453 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca016349-1fc3-4b73-be22-519ce9f2fd4a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:59.847193 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca016349-1fc3-4b73-be22-519ce9f2fd4a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:59.848285 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca016349-1fc3-4b73-be22-519ce9f2fd4a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:59.849375 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca016349-1fc3-4b73-be22-519ce9f2fd4a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:59.850322 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca016349-1fc3-4b73-be22-519ce9f2fd4a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:59.864898 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:59.865496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:59.866006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:59.866688 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lazy-loading 'fault' on Instance uuid 1f305831-eafb-4667-a621-cb2bf89c07c1 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:24:59.926063 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:59.935455 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d8901bac-e78d-4e80-96cd-c0591a874b4c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 200 len: 1332 microversion: 2.1 time: 0.132942 Aug 30 01:24:59.952175 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 404/808] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:59 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 1332 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:00.006676 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ca016349-1fc3-4b73-be22-519ce9f2fd4a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:00.015432 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ca016349-1fc3-4b73-be22-519ce9f2fd4a tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1209 microversion: 2.1 time: 0.184362 Aug 30 01:25:00.016300 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 405/809] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:59 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1209 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:25:00.958346 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f518e56e-1217-427d-98e9-26005b00e245 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:00.959660 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f518e56e-1217-427d-98e9-26005b00e245 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:00.967273 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f518e56e-1217-427d-98e9-26005b00e245 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:00.967759 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f518e56e-1217-427d-98e9-26005b00e245 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:00.968244 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f518e56e-1217-427d-98e9-26005b00e245 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:00.968943 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f518e56e-1217-427d-98e9-26005b00e245 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:00.969466 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f518e56e-1217-427d-98e9-26005b00e245 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:00.969895 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f518e56e-1217-427d-98e9-26005b00e245 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:00.985094 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-f518e56e-1217-427d-98e9-26005b00e245 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f518e56e-1217-427d-98e9-26005b00e245 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 HTTP/1.1 Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:25:00.986639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:25:00.988387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:25:00.988387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:25:00.988387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:25:00.988387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:25:00.988387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:25:00.988387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:25:00.988387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:25:00.988387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:25:00.988387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:25:00.988387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:25:00.988387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:25:00.988387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '1f305831-eafb-4667-a621-cb2bf89c07c1'} Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:25:00.989413 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:25:00.990953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:25:00.992383 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f518e56e-1217-427d-98e9-26005b00e245 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 404 to user: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:25:00.992383 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f518e56e-1217-427d-98e9-26005b00e245 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 404 len: 111 microversion: 2.1 time: 0.033981 Aug 30 01:25:00.992383 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 405/810] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:00 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:25:00.997612 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0776f0a5-ab8d-4956-bcab-35a2bb27e03c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '.version_select at 0x7ff48ac4b160>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:01.016832 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0776f0a5-ab8d-4956-bcab-35a2bb27e03c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386963757" status: 202 len: 0 microversion: 2.1 time: 0.022913 Aug 30 01:25:01.017418 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 406/811] 10.222.0.44 () {58 vars in 1221 bytes} [Tue Aug 30 01:25:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386963757 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:25:01.036942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c15aca22-1f78-4052-a764-63c0a383aa02 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:01.037557 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c15aca22-1f78-4052-a764-63c0a383aa02 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:01.044494 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c15aca22-1f78-4052-a764-63c0a383aa02 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:01.044981 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c15aca22-1f78-4052-a764-63c0a383aa02 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:01.045419 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c15aca22-1f78-4052-a764-63c0a383aa02 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:01.046124 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c15aca22-1f78-4052-a764-63c0a383aa02 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:01.046569 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c15aca22-1f78-4052-a764-63c0a383aa02 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:01.047236 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c15aca22-1f78-4052-a764-63c0a383aa02 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:01.095348 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-b6319f28-328a-4810-a0aa-d139b3542921 req-fffcd347-dde2-41b5-8305-1fc396098e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de457d90-8262-4854-a4d9-7ed485c8e630", "tag": "83b9c452-82e4-4050-a7d3-fbb86ea64e52"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:01.106228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b6319f28-328a-4810-a0aa-d139b3542921 req-fffcd347-dde2-41b5-8305-1fc396098e79 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:01.106808 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b6319f28-328a-4810-a0aa-d139b3542921 req-fffcd347-dde2-41b5-8305-1fc396098e79 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:01.107560 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b6319f28-328a-4810-a0aa-d139b3542921 req-fffcd347-dde2-41b5-8305-1fc396098e79 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:01.118902 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-b6319f28-328a-4810-a0aa-d139b3542921 req-fffcd347-dde2-41b5-8305-1fc396098e79 service nova] Creating event network-changed:83b9c452-82e4-4050-a7d3-fbb86ea64e52 for instance de457d90-8262-4854-a4d9-7ed485c8e630 on hv-cinder-81514 Aug 30 01:25:01.134058 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-b6319f28-328a-4810-a0aa-d139b3542921 req-fffcd347-dde2-41b5-8305-1fc396098e79 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041019 Aug 30 01:25:01.134850 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 407/812] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:25:01.288771 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c15aca22-1f78-4052-a764-63c0a383aa02 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:01.299163 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c15aca22-1f78-4052-a764-63c0a383aa02 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1265 microversion: 2.1 time: 0.265869 Aug 30 01:25:01.312876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 406/813] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:01 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:01.812180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-81815a4a-53bd-4976-bf9c-bef0d82bc463 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:01.812757 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-81815a4a-53bd-4976-bf9c-bef0d82bc463 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:01.819886 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81815a4a-53bd-4976-bf9c-bef0d82bc463 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:01.820520 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81815a4a-53bd-4976-bf9c-bef0d82bc463 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:01.821114 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81815a4a-53bd-4976-bf9c-bef0d82bc463 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:01.821956 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81815a4a-53bd-4976-bf9c-bef0d82bc463 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:01.822417 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81815a4a-53bd-4976-bf9c-bef0d82bc463 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:01.822847 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81815a4a-53bd-4976-bf9c-bef0d82bc463 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:01.913642 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-81815a4a-53bd-4976-bf9c-bef0d82bc463 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lazy-loading 'services' on Instance uuid 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:25:01.988478 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-81815a4a-53bd-4976-bf9c-bef0d82bc463 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1/os-volume_attachments/3dd0eea5-bc74-4e7b-aaa7-1c3fc3c9affd" status: 202 len: 0 microversion: 2.1 time: 0.180373 Aug 30 01:25:01.989071 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 408/814] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Aug 30 01:25:01 2022] DELETE /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1/os-volume_attachments/3dd0eea5-bc74-4e7b-aaa7-1c3fc3c9affd => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:25:01.998133 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e53cce54-b09d-4688-bf89-f091e91a720d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:02.000678 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e53cce54-b09d-4688-bf89-f091e91a720d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:02.007018 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e53cce54-b09d-4688-bf89-f091e91a720d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:02.007504 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e53cce54-b09d-4688-bf89-f091e91a720d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:02.008565 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e53cce54-b09d-4688-bf89-f091e91a720d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:02.010250 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e53cce54-b09d-4688-bf89-f091e91a720d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:02.010411 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e53cce54-b09d-4688-bf89-f091e91a720d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:02.011079 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e53cce54-b09d-4688-bf89-f091e91a720d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:02.046581 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e53cce54-b09d-4688-bf89-f091e91a720d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052365 Aug 30 01:25:02.047489 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 407/815] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:25:01 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:25:02.323338 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f21a9472-3ad4-465a-b7ed-334e37a6ea27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:02.323970 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f21a9472-3ad4-465a-b7ed-334e37a6ea27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:02.330269 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f21a9472-3ad4-465a-b7ed-334e37a6ea27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:02.330748 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f21a9472-3ad4-465a-b7ed-334e37a6ea27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:02.331173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f21a9472-3ad4-465a-b7ed-334e37a6ea27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:02.331850 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f21a9472-3ad4-465a-b7ed-334e37a6ea27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:02.332329 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f21a9472-3ad4-465a-b7ed-334e37a6ea27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:02.332743 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f21a9472-3ad4-465a-b7ed-334e37a6ea27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:02.464764 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f21a9472-3ad4-465a-b7ed-334e37a6ea27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:02.472434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f21a9472-3ad4-465a-b7ed-334e37a6ea27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1265 microversion: 2.1 time: 0.154029 Aug 30 01:25:02.473009 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 409/816] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:02 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:03.060462 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0793c9da-fb96-4746-b832-d447b1c8b101 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:03.062716 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0793c9da-fb96-4746-b832-d447b1c8b101 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:03.069495 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0793c9da-fb96-4746-b832-d447b1c8b101 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:03.069977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0793c9da-fb96-4746-b832-d447b1c8b101 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:03.070448 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0793c9da-fb96-4746-b832-d447b1c8b101 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:03.071781 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0793c9da-fb96-4746-b832-d447b1c8b101 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:03.072262 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0793c9da-fb96-4746-b832-d447b1c8b101 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:03.072696 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0793c9da-fb96-4746-b832-d447b1c8b101 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:03.105033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0793c9da-fb96-4746-b832-d447b1c8b101 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049793 Aug 30 01:25:03.105611 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 408/817] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:25:03 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:25:03.174140 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d2d49e35-24ef-4f3a-bf9c-cfd6cda32097 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:03.174638 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d2d49e35-24ef-4f3a-bf9c-cfd6cda32097 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:03.181798 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d2d49e35-24ef-4f3a-bf9c-cfd6cda32097 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:03.182284 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d2d49e35-24ef-4f3a-bf9c-cfd6cda32097 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:03.182722 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d2d49e35-24ef-4f3a-bf9c-cfd6cda32097 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:03.183412 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d2d49e35-24ef-4f3a-bf9c-cfd6cda32097 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:03.183873 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d2d49e35-24ef-4f3a-bf9c-cfd6cda32097 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:03.184327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d2d49e35-24ef-4f3a-bf9c-cfd6cda32097 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:03.212070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d2d49e35-24ef-4f3a-bf9c-cfd6cda32097 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:25:03.292322 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d2d49e35-24ef-4f3a-bf9c-cfd6cda32097 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 204 len: 0 microversion: 2.1 time: 0.121709 Aug 30 01:25:03.293242 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 410/818] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:25:03 2022] DELETE /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:25:03.301190 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0b0d0402-7bd7-492e-b98d-58bc923058d2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:03.301789 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0b0d0402-7bd7-492e-b98d-58bc923058d2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:03.309214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0b0d0402-7bd7-492e-b98d-58bc923058d2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:03.309725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0b0d0402-7bd7-492e-b98d-58bc923058d2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:03.310193 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0b0d0402-7bd7-492e-b98d-58bc923058d2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:03.310977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0b0d0402-7bd7-492e-b98d-58bc923058d2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:03.311373 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0b0d0402-7bd7-492e-b98d-58bc923058d2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:03.311796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0b0d0402-7bd7-492e-b98d-58bc923058d2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:03.451282 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0b0d0402-7bd7-492e-b98d-58bc923058d2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:03.459070 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0b0d0402-7bd7-492e-b98d-58bc923058d2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1680 microversion: 2.1 time: 0.161651 Aug 30 01:25:03.459638 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 409/819] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:03 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:25:03.494567 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d8b18753-cd6d-4fe9-821b-56942b73c236 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:03.495337 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d8b18753-cd6d-4fe9-821b-56942b73c236 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:03.503152 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d8b18753-cd6d-4fe9-821b-56942b73c236 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:03.503637 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d8b18753-cd6d-4fe9-821b-56942b73c236 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:03.504104 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d8b18753-cd6d-4fe9-821b-56942b73c236 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:03.504807 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d8b18753-cd6d-4fe9-821b-56942b73c236 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:03.505259 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d8b18753-cd6d-4fe9-821b-56942b73c236 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:03.505684 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d8b18753-cd6d-4fe9-821b-56942b73c236 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:03.637952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d8b18753-cd6d-4fe9-821b-56942b73c236 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:03.645567 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d8b18753-cd6d-4fe9-821b-56942b73c236 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1265 microversion: 2.1 time: 0.155996 Aug 30 01:25:03.646121 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 411/820] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:03 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:04.480778 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-201a6093-51af-404e-a1e0-07246bb710f5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:04.481599 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-201a6093-51af-404e-a1e0-07246bb710f5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:04.489813 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-201a6093-51af-404e-a1e0-07246bb710f5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:04.490299 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-201a6093-51af-404e-a1e0-07246bb710f5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:04.490733 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-201a6093-51af-404e-a1e0-07246bb710f5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:04.491434 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-201a6093-51af-404e-a1e0-07246bb710f5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:04.491884 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-201a6093-51af-404e-a1e0-07246bb710f5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:04.492856 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-201a6093-51af-404e-a1e0-07246bb710f5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:04.628553 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-201a6093-51af-404e-a1e0-07246bb710f5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:04.637581 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-201a6093-51af-404e-a1e0-07246bb710f5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1680 microversion: 2.1 time: 0.161098 Aug 30 01:25:04.638174 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 410/821] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:04 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:04.668427 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d1dc7f59-bbee-4bc3-bb20-5be653e211a6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:04.669216 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d1dc7f59-bbee-4bc3-bb20-5be653e211a6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:04.677290 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1dc7f59-bbee-4bc3-bb20-5be653e211a6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:04.677772 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1dc7f59-bbee-4bc3-bb20-5be653e211a6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:04.678438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1dc7f59-bbee-4bc3-bb20-5be653e211a6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:04.679470 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1dc7f59-bbee-4bc3-bb20-5be653e211a6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:04.680472 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1dc7f59-bbee-4bc3-bb20-5be653e211a6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:04.681345 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1dc7f59-bbee-4bc3-bb20-5be653e211a6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:04.846975 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d1dc7f59-bbee-4bc3-bb20-5be653e211a6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:04.861161 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d1dc7f59-bbee-4bc3-bb20-5be653e211a6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1265 microversion: 2.1 time: 0.198291 Aug 30 01:25:04.861748 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 412/822] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:04 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:05.658834 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d0abf802-3dc8-4bc8-94e2-e96f59f17570 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:05.659447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d0abf802-3dc8-4bc8-94e2-e96f59f17570 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:05.666311 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0abf802-3dc8-4bc8-94e2-e96f59f17570 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:05.666786 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0abf802-3dc8-4bc8-94e2-e96f59f17570 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:05.667212 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0abf802-3dc8-4bc8-94e2-e96f59f17570 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:05.667898 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0abf802-3dc8-4bc8-94e2-e96f59f17570 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:05.668369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0abf802-3dc8-4bc8-94e2-e96f59f17570 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:05.668785 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0abf802-3dc8-4bc8-94e2-e96f59f17570 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:05.737825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d0abf802-3dc8-4bc8-94e2-e96f59f17570 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:05.746516 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d0abf802-3dc8-4bc8-94e2-e96f59f17570 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1613 microversion: 2.1 time: 0.091394 Aug 30 01:25:05.747664 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 411/823] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:05 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1613 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:05.882426 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-eacec6cf-8d79-43a9-aabf-e19faa3a52b6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:05.883713 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-eacec6cf-8d79-43a9-aabf-e19faa3a52b6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:05.890481 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eacec6cf-8d79-43a9-aabf-e19faa3a52b6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:05.890965 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eacec6cf-8d79-43a9-aabf-e19faa3a52b6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:05.891396 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eacec6cf-8d79-43a9-aabf-e19faa3a52b6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:05.892189 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eacec6cf-8d79-43a9-aabf-e19faa3a52b6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:05.892637 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eacec6cf-8d79-43a9-aabf-e19faa3a52b6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:05.893056 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eacec6cf-8d79-43a9-aabf-e19faa3a52b6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:06.096641 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-44ab0718-e2b7-447f-87d9-8b148d108130 req-3620cab2-4ba6-45a2-a89d-0cc955f8a293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1", "name": "network-vif-deleted", "tag": "adf859bc-f00d-4d63-92fe-ba1e7b8709cd"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:06.113701 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-eacec6cf-8d79-43a9-aabf-e19faa3a52b6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:06.124845 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-eacec6cf-8d79-43a9-aabf-e19faa3a52b6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1265 microversion: 2.1 time: 0.246121 Aug 30 01:25:06.126020 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 413/824] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:05 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:06.130727 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-44ab0718-e2b7-447f-87d9-8b148d108130 req-3620cab2-4ba6-45a2-a89d-0cc955f8a293 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:06.131267 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-44ab0718-e2b7-447f-87d9-8b148d108130 req-3620cab2-4ba6-45a2-a89d-0cc955f8a293 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:06.131925 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-44ab0718-e2b7-447f-87d9-8b148d108130 req-3620cab2-4ba6-45a2-a89d-0cc955f8a293 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:06.150892 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-44ab0718-e2b7-447f-87d9-8b148d108130 req-3620cab2-4ba6-45a2-a89d-0cc955f8a293 service nova] Creating event network-vif-deleted:adf859bc-f00d-4d63-92fe-ba1e7b8709cd for instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 on hv-cinder-81514 Aug 30 01:25:06.156221 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-44ab0718-e2b7-447f-87d9-8b148d108130 req-3620cab2-4ba6-45a2-a89d-0cc955f8a293 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066026 Aug 30 01:25:06.156822 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 412/825] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:25:06.768565 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:06.769224 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:06.776142 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:06.776630 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:06.777067 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:06.777764 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:06.778216 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:06.778640 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:06.813757 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:06.814237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:06.814665 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:06.815140 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lazy-loading 'fault' on Instance uuid 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:25:06.856213 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:06.864637 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-15c3abc1-c5b0-454f-9a2f-7cb6838da94d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 200 len: 1331 microversion: 2.1 time: 0.099680 Aug 30 01:25:06.865308 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 414/826] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:06 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:07.152035 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a1dc5033-72e9-4c77-8142-2f7dc0de35ff tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:07.152788 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a1dc5033-72e9-4c77-8142-2f7dc0de35ff tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:07.159553 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1dc5033-72e9-4c77-8142-2f7dc0de35ff tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:07.160062 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1dc5033-72e9-4c77-8142-2f7dc0de35ff tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:07.160499 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1dc5033-72e9-4c77-8142-2f7dc0de35ff tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:07.161198 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1dc5033-72e9-4c77-8142-2f7dc0de35ff tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:07.161657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1dc5033-72e9-4c77-8142-2f7dc0de35ff tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:07.162085 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1dc5033-72e9-4c77-8142-2f7dc0de35ff tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:07.563974 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a1dc5033-72e9-4c77-8142-2f7dc0de35ff tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:07.572537 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a1dc5033-72e9-4c77-8142-2f7dc0de35ff tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1265 microversion: 2.1 time: 0.425961 Aug 30 01:25:07.573108 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 413/827] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:07 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1265 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:07.886731 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-da0922af-191e-4cac-b8f4-299a58f05225 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:07.887354 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-da0922af-191e-4cac-b8f4-299a58f05225 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:07.889848 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:07.891214 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:07.896984 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-da0922af-191e-4cac-b8f4-299a58f05225 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:07.897462 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-da0922af-191e-4cac-b8f4-299a58f05225 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:07.897890 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-da0922af-191e-4cac-b8f4-299a58f05225 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:07.899242 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-da0922af-191e-4cac-b8f4-299a58f05225 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:07.899716 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-da0922af-191e-4cac-b8f4-299a58f05225 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:07.900139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-da0922af-191e-4cac-b8f4-299a58f05225 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:07.915329 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-da0922af-191e-4cac-b8f4-299a58f05225 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-da0922af-191e-4cac-b8f4-299a58f05225 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 HTTP/1.1 Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:25:07.916991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:25:07.918666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:25:07.918666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:25:07.918666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:25:07.918666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:25:07.918666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:25:07.918666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:25:07.918666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:25:07.918666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:25:07.918666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:25:07.918666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:25:07.918666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:25:07.918666 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1'} Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:25:07.919554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:25:07.921089 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:25:07.922430 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-da0922af-191e-4cac-b8f4-299a58f05225 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 404 to user: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:25:07.922430 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-da0922af-191e-4cac-b8f4-299a58f05225 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 404 len: 111 microversion: 2.1 time: 0.036062 Aug 30 01:25:07.922430 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 415/828] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:07 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:25:07.927369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e468b33a-835d-48a3-bbd1-3415fb3d1920 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '.version_select at 0x7ff48ad7ac10>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:07.935377 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:07.950673 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e468b33a-835d-48a3-bbd1-3415fb3d1920 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1674744055" status: 202 len: 0 microversion: 2.1 time: 0.027114 Aug 30 01:25:07.951282 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 414/829] 10.222.0.44 () {58 vars in 1221 bytes} [Tue Aug 30 01:25:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1674744055 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:25:08.589897 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7ea15c69-7fd0-4d20-8248-53823a2f360b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Action: 'create', calling method: .version_select at 0x7ff48ad24c10>, body: {"keypair": {"name": "tempest-keypair-1533221894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoAIahXcUQWB888jxp8cpV4Gekg/jZMVQJvl/XTHIvFDzG1fbUSRJ9GmSssAumXkN4S7hPzxsZjPoerYGbUsrB/ouTm8UKDhEu6LvEgEbj1hVxV3DAlXwanl7mzhJxS7A=="}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:08.593090 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-208ef58a-4b1f-49f9-b562-d8e68589ae94 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:08.593710 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-208ef58a-4b1f-49f9-b562-d8e68589ae94 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:08.600346 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-208ef58a-4b1f-49f9-b562-d8e68589ae94 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:08.600855 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-208ef58a-4b1f-49f9-b562-d8e68589ae94 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:08.601928 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-208ef58a-4b1f-49f9-b562-d8e68589ae94 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:08.602595 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-208ef58a-4b1f-49f9-b562-d8e68589ae94 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:08.603041 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-208ef58a-4b1f-49f9-b562-d8e68589ae94 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:08.603521 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-208ef58a-4b1f-49f9-b562-d8e68589ae94 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:08.606644 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-7ea15c69-7fd0-4d20-8248-53823a2f360b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for project f5ddbf041c444253aea027770188fbaf. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:25:08.612323 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-7ea15c69-7fd0-4d20-8248-53823a2f360b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for user 4fe36a87392c40379ac160ebaa3cd84c and project f5ddbf041c444253aea027770188fbaf. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:25:08.635199 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7ea15c69-7fd0-4d20-8248-53823a2f360b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049872 Aug 30 01:25:08.635803 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 416/830] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Aug 30 01:25:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:25:08.750872 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-208ef58a-4b1f-49f9-b562-d8e68589ae94 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:08.759658 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-208ef58a-4b1f-49f9-b562-d8e68589ae94 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1265 microversion: 2.1 time: 0.170299 Aug 30 01:25:08.760265 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 415/831] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:08 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:25:09.781527 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-845d753e-11fe-4761-bc55-559fab2baee3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:09.782846 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-845d753e-11fe-4761-bc55-559fab2baee3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:09.791274 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-845d753e-11fe-4761-bc55-559fab2baee3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:09.791737 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-845d753e-11fe-4761-bc55-559fab2baee3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:09.792479 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-845d753e-11fe-4761-bc55-559fab2baee3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:09.793216 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-845d753e-11fe-4761-bc55-559fab2baee3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:09.793667 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-845d753e-11fe-4761-bc55-559fab2baee3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:09.794272 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-845d753e-11fe-4761-bc55-559fab2baee3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:09.798907 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:10.040186 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-845d753e-11fe-4761-bc55-559fab2baee3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:10.048755 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-845d753e-11fe-4761-bc55-559fab2baee3 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1265 microversion: 2.1 time: 0.271616 Aug 30 01:25:10.049421 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 417/832] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:09 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:10.293326 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1802669483", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "129a2c61-8cde-4190-8f30-dda20a50e18f"}], "security_groups": [{"name": "tempest-securitygroup--1108001027"}], "key_name": "tempest-keypair-1533221894", "user_data": "}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:10.400258 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] validate_networks() for [('129a2c61-8cde-4190-8f30-dda20a50e18f', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:25:10.773171 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:25:10.773594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:25:10.774144 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:25:10.774651 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:25:10.775149 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:25:10.784226 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:10.784709 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:10.785145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:10.785875 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:10.786327 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:10.786765 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:10.803488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for project f5ddbf041c444253aea027770188fbaf. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:25:10.808247 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for user 4fe36a87392c40379ac160ebaa3cd84c and project f5ddbf041c444253aea027770188fbaf. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:25:10.819296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:25:10.822145 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:25:10.869571 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9368ae6a-d783-49b0-88b0-9da113cea4d3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.581190 Aug 30 01:25:10.870148 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 416/833] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:25:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:25:10.880873 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-75a9fc9e-d010-4271-802c-4e2386e5aff6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:10.881574 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-75a9fc9e-d010-4271-802c-4e2386e5aff6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:10.939053 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-75a9fc9e-d010-4271-802c-4e2386e5aff6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:10.947210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-75a9fc9e-d010-4271-802c-4e2386e5aff6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1242 microversion: 2.1 time: 0.070141 Aug 30 01:25:10.947786 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 418/834] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:10 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:11.069161 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8d9e1c98-4d41-4ad1-b97a-557b9a814a27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:11.070588 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8d9e1c98-4d41-4ad1-b97a-557b9a814a27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:11.077283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d9e1c98-4d41-4ad1-b97a-557b9a814a27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:11.077850 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d9e1c98-4d41-4ad1-b97a-557b9a814a27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:11.078326 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d9e1c98-4d41-4ad1-b97a-557b9a814a27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:11.079132 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d9e1c98-4d41-4ad1-b97a-557b9a814a27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:11.079586 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d9e1c98-4d41-4ad1-b97a-557b9a814a27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:11.080030 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d9e1c98-4d41-4ad1-b97a-557b9a814a27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:11.248363 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d9e1c98-4d41-4ad1-b97a-557b9a814a27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:11.256491 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8d9e1c98-4d41-4ad1-b97a-557b9a814a27 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1265 microversion: 2.1 time: 0.191172 Aug 30 01:25:11.257676 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 417/835] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:11 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:11.918642 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-1a278516-b6e9-47e0-8cfd-4af7da777ea5 req-159cf9d9-806c-4183-927d-408e004a8ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de457d90-8262-4854-a4d9-7ed485c8e630", "name": "network-vif-plugged", "status": "completed", "tag": "83b9c452-82e4-4050-a7d3-fbb86ea64e52"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:11.931533 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1a278516-b6e9-47e0-8cfd-4af7da777ea5 req-159cf9d9-806c-4183-927d-408e004a8ca1 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:11.932228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1a278516-b6e9-47e0-8cfd-4af7da777ea5 req-159cf9d9-806c-4183-927d-408e004a8ca1 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:11.932660 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1a278516-b6e9-47e0-8cfd-4af7da777ea5 req-159cf9d9-806c-4183-927d-408e004a8ca1 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:11.943156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-1a278516-b6e9-47e0-8cfd-4af7da777ea5 req-159cf9d9-806c-4183-927d-408e004a8ca1 service nova] Creating event network-vif-plugged:83b9c452-82e4-4050-a7d3-fbb86ea64e52 for instance de457d90-8262-4854-a4d9-7ed485c8e630 on hv-cinder-81514 Aug 30 01:25:11.950112 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-1a278516-b6e9-47e0-8cfd-4af7da777ea5 req-159cf9d9-806c-4183-927d-408e004a8ca1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035235 Aug 30 01:25:11.950885 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 419/836] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:25:11.967755 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f4d68be3-908c-40e8-a4a6-8e51c6666206 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:11.968396 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f4d68be3-908c-40e8-a4a6-8e51c6666206 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:11.974702 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4d68be3-908c-40e8-a4a6-8e51c6666206 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:11.975202 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4d68be3-908c-40e8-a4a6-8e51c6666206 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:11.975979 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4d68be3-908c-40e8-a4a6-8e51c6666206 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:11.976688 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4d68be3-908c-40e8-a4a6-8e51c6666206 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:11.977137 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4d68be3-908c-40e8-a4a6-8e51c6666206 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:11.977555 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4d68be3-908c-40e8-a4a6-8e51c6666206 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:12.042006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f4d68be3-908c-40e8-a4a6-8e51c6666206 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:12.051003 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f4d68be3-908c-40e8-a4a6-8e51c6666206 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1294 microversion: 2.1 time: 0.086870 Aug 30 01:25:12.052757 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 418/837] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:11 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:12.280992 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-21c5eddf-4069-4f12-8731-28ac90de37b5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:12.282115 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-21c5eddf-4069-4f12-8731-28ac90de37b5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:12.291986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-21c5eddf-4069-4f12-8731-28ac90de37b5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:12.292936 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-21c5eddf-4069-4f12-8731-28ac90de37b5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:12.293452 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-21c5eddf-4069-4f12-8731-28ac90de37b5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:12.294376 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-21c5eddf-4069-4f12-8731-28ac90de37b5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:12.294903 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-21c5eddf-4069-4f12-8731-28ac90de37b5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:12.295334 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-21c5eddf-4069-4f12-8731-28ac90de37b5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:12.533913 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-21c5eddf-4069-4f12-8731-28ac90de37b5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:12.541785 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-21c5eddf-4069-4f12-8731-28ac90de37b5 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1265 microversion: 2.1 time: 0.266989 Aug 30 01:25:12.542366 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 420/838] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:12 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:13.084833 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-afa32866-b671-438a-854b-33648297a4e6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:13.085941 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-afa32866-b671-438a-854b-33648297a4e6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:13.098249 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-afa32866-b671-438a-854b-33648297a4e6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:13.099168 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-afa32866-b671-438a-854b-33648297a4e6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:13.099942 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-afa32866-b671-438a-854b-33648297a4e6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:13.101787 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-afa32866-b671-438a-854b-33648297a4e6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:13.102628 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-afa32866-b671-438a-854b-33648297a4e6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:13.103515 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-afa32866-b671-438a-854b-33648297a4e6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:13.112154 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:13.311265 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-afa32866-b671-438a-854b-33648297a4e6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:13.319937 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-afa32866-b671-438a-854b-33648297a4e6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1368 microversion: 2.1 time: 0.242333 Aug 30 01:25:13.320557 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 419/839] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:13 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:13.568532 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-aba7f4bc-5814-4b35-88ba-36701fada3c4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:13.569985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-aba7f4bc-5814-4b35-88ba-36701fada3c4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:13.582045 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aba7f4bc-5814-4b35-88ba-36701fada3c4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:13.582915 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aba7f4bc-5814-4b35-88ba-36701fada3c4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:13.583481 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aba7f4bc-5814-4b35-88ba-36701fada3c4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:13.584466 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aba7f4bc-5814-4b35-88ba-36701fada3c4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:13.585022 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aba7f4bc-5814-4b35-88ba-36701fada3c4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:13.585513 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aba7f4bc-5814-4b35-88ba-36701fada3c4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:13.805836 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-aba7f4bc-5814-4b35-88ba-36701fada3c4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:13.814517 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-aba7f4bc-5814-4b35-88ba-36701fada3c4 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1453 microversion: 2.1 time: 0.254618 Aug 30 01:25:13.815105 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 421/840] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:13 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1453 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:13.836638 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3e4db2f1-df8d-4002-a465-8999bb169493 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:13.837278 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3e4db2f1-df8d-4002-a465-8999bb169493 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:13.843878 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e4db2f1-df8d-4002-a465-8999bb169493 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:13.844417 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e4db2f1-df8d-4002-a465-8999bb169493 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:13.845244 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e4db2f1-df8d-4002-a465-8999bb169493 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:13.846067 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e4db2f1-df8d-4002-a465-8999bb169493 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:13.846910 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e4db2f1-df8d-4002-a465-8999bb169493 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:13.847447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e4db2f1-df8d-4002-a465-8999bb169493 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:13.909546 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-8d783f2e-a108-413e-8ef7-786c3c12f18c req-b4a1e060-87d9-4ede-b043-30ec5dbce8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b8c9b12-8dc1-4e3d-988c-12717b48b0b9", "tag": "4fbaf152-1777-4942-b763-c703e397257b"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:13.926398 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-8d783f2e-a108-413e-8ef7-786c3c12f18c req-b4a1e060-87d9-4ede-b043-30ec5dbce8a8 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:13.927791 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-8d783f2e-a108-413e-8ef7-786c3c12f18c req-b4a1e060-87d9-4ede-b043-30ec5dbce8a8 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:13.929234 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-8d783f2e-a108-413e-8ef7-786c3c12f18c req-b4a1e060-87d9-4ede-b043-30ec5dbce8a8 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:13.946068 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-8d783f2e-a108-413e-8ef7-786c3c12f18c req-b4a1e060-87d9-4ede-b043-30ec5dbce8a8 service nova] Creating event network-changed:4fbaf152-1777-4942-b763-c703e397257b for instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 on hv-cinder-81514 Aug 30 01:25:13.953675 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-8d783f2e-a108-413e-8ef7-786c3c12f18c req-b4a1e060-87d9-4ede-b043-30ec5dbce8a8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050346 Aug 30 01:25:13.955199 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 422/841] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:25:14.006102 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3e4db2f1-df8d-4002-a465-8999bb169493 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:14.019435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3e4db2f1-df8d-4002-a465-8999bb169493 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1453 microversion: 2.1 time: 0.186986 Aug 30 01:25:14.020046 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 420/842] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:13 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:14.356306 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b81a6e86-6ec0-4e18-9445-e4c87002052e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:14.356991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b81a6e86-6ec0-4e18-9445-e4c87002052e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:14.365453 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b81a6e86-6ec0-4e18-9445-e4c87002052e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:14.365953 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b81a6e86-6ec0-4e18-9445-e4c87002052e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:14.366461 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b81a6e86-6ec0-4e18-9445-e4c87002052e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:14.367163 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b81a6e86-6ec0-4e18-9445-e4c87002052e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:14.367620 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b81a6e86-6ec0-4e18-9445-e4c87002052e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:14.368090 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b81a6e86-6ec0-4e18-9445-e4c87002052e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:14.593372 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b81a6e86-6ec0-4e18-9445-e4c87002052e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:14.602529 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b81a6e86-6ec0-4e18-9445-e4c87002052e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1368 microversion: 2.1 time: 0.251872 Aug 30 01:25:14.603457 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 423/843] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:14 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:15.624238 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e4ad22a7-015b-4a2f-afe7-f2322238c103 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:15.625040 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e4ad22a7-015b-4a2f-afe7-f2322238c103 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:15.633762 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4ad22a7-015b-4a2f-afe7-f2322238c103 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:15.634420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4ad22a7-015b-4a2f-afe7-f2322238c103 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:15.634994 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4ad22a7-015b-4a2f-afe7-f2322238c103 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:15.635815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4ad22a7-015b-4a2f-afe7-f2322238c103 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:15.636876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4ad22a7-015b-4a2f-afe7-f2322238c103 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:15.637332 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4ad22a7-015b-4a2f-afe7-f2322238c103 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:15.785912 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-0a125167-a610-4e16-92e8-3eb9b3731592 req-881e641b-6dd6-428d-9515-77468bcae559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de457d90-8262-4854-a4d9-7ed485c8e630", "tag": "83b9c452-82e4-4050-a7d3-fbb86ea64e52"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:15.796864 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0a125167-a610-4e16-92e8-3eb9b3731592 req-881e641b-6dd6-428d-9515-77468bcae559 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:15.797585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0a125167-a610-4e16-92e8-3eb9b3731592 req-881e641b-6dd6-428d-9515-77468bcae559 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:15.798201 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0a125167-a610-4e16-92e8-3eb9b3731592 req-881e641b-6dd6-428d-9515-77468bcae559 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:15.814511 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-0a125167-a610-4e16-92e8-3eb9b3731592 req-881e641b-6dd6-428d-9515-77468bcae559 service nova] Creating event network-changed:83b9c452-82e4-4050-a7d3-fbb86ea64e52 for instance de457d90-8262-4854-a4d9-7ed485c8e630 on hv-cinder-81514 Aug 30 01:25:15.821340 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-0a125167-a610-4e16-92e8-3eb9b3731592 req-881e641b-6dd6-428d-9515-77468bcae559 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038961 Aug 30 01:25:15.822540 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 424/844] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:25:15.848442 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e4ad22a7-015b-4a2f-afe7-f2322238c103 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:15.857344 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e4ad22a7-015b-4a2f-afe7-f2322238c103 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1368 microversion: 2.1 time: 0.237217 Aug 30 01:25:15.860599 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 421/845] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:15 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:16.879510 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f9efcfe8-eb83-4129-aeef-dac703aabac0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:16.880267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f9efcfe8-eb83-4129-aeef-dac703aabac0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:16.887139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f9efcfe8-eb83-4129-aeef-dac703aabac0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:16.887665 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f9efcfe8-eb83-4129-aeef-dac703aabac0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:16.888150 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f9efcfe8-eb83-4129-aeef-dac703aabac0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:16.888839 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f9efcfe8-eb83-4129-aeef-dac703aabac0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:16.889289 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f9efcfe8-eb83-4129-aeef-dac703aabac0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:16.889714 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f9efcfe8-eb83-4129-aeef-dac703aabac0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:17.029955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f9efcfe8-eb83-4129-aeef-dac703aabac0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:17.038051 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f9efcfe8-eb83-4129-aeef-dac703aabac0 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1368 microversion: 2.1 time: 0.163031 Aug 30 01:25:17.038648 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 425/846] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:16 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:18.064788 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e5e332f1-7cd4-4aa1-a1a4-14aaea3a8088 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:18.066058 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e5e332f1-7cd4-4aa1-a1a4-14aaea3a8088 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:18.073022 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5e332f1-7cd4-4aa1-a1a4-14aaea3a8088 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:18.073504 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5e332f1-7cd4-4aa1-a1a4-14aaea3a8088 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:18.073948 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5e332f1-7cd4-4aa1-a1a4-14aaea3a8088 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:18.074803 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5e332f1-7cd4-4aa1-a1a4-14aaea3a8088 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:18.075255 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5e332f1-7cd4-4aa1-a1a4-14aaea3a8088 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:18.075824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5e332f1-7cd4-4aa1-a1a4-14aaea3a8088 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:18.377670 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e5e332f1-7cd4-4aa1-a1a4-14aaea3a8088 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:18.385762 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e5e332f1-7cd4-4aa1-a1a4-14aaea3a8088 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1368 microversion: 2.1 time: 0.328822 Aug 30 01:25:18.386465 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 422/847] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:18 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1368 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:25:19.407552 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5c2ba93c-486b-4b8b-89ce-f5002e9b6ccd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:19.408206 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5c2ba93c-486b-4b8b-89ce-f5002e9b6ccd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:19.415531 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5c2ba93c-486b-4b8b-89ce-f5002e9b6ccd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:19.416033 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5c2ba93c-486b-4b8b-89ce-f5002e9b6ccd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:19.416475 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5c2ba93c-486b-4b8b-89ce-f5002e9b6ccd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:19.417175 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5c2ba93c-486b-4b8b-89ce-f5002e9b6ccd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:19.417633 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5c2ba93c-486b-4b8b-89ce-f5002e9b6ccd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:19.418056 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5c2ba93c-486b-4b8b-89ce-f5002e9b6ccd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:19.556481 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5c2ba93c-486b-4b8b-89ce-f5002e9b6ccd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:19.564169 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5c2ba93c-486b-4b8b-89ce-f5002e9b6ccd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1368 microversion: 2.1 time: 0.160486 Aug 30 01:25:19.564741 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 426/848] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:19 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:19.966225 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-2ef98374-9096-4836-81a7-75e80df75816 req-a1e9c74a-0043-41a4-b6f2-c5a42752f9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b8c9b12-8dc1-4e3d-988c-12717b48b0b9", "name": "network-vif-plugged", "status": "completed", "tag": "4fbaf152-1777-4942-b763-c703e397257b"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:19.983464 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2ef98374-9096-4836-81a7-75e80df75816 req-a1e9c74a-0043-41a4-b6f2-c5a42752f9b4 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:19.984420 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2ef98374-9096-4836-81a7-75e80df75816 req-a1e9c74a-0043-41a4-b6f2-c5a42752f9b4 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:19.985198 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2ef98374-9096-4836-81a7-75e80df75816 req-a1e9c74a-0043-41a4-b6f2-c5a42752f9b4 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:20.009219 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-2ef98374-9096-4836-81a7-75e80df75816 req-a1e9c74a-0043-41a4-b6f2-c5a42752f9b4 service nova] Creating event network-vif-plugged:4fbaf152-1777-4942-b763-c703e397257b for instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 on hv-cinder-81514 Aug 30 01:25:20.016077 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-2ef98374-9096-4836-81a7-75e80df75816 req-a1e9c74a-0043-41a4-b6f2-c5a42752f9b4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058045 Aug 30 01:25:20.016712 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 423/849] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:25:20.585945 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-81e58ad5-41c4-4447-b6dc-19fae3245e0c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:20.586523 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-81e58ad5-41c4-4447-b6dc-19fae3245e0c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:20.590134 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:20.593705 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81e58ad5-41c4-4447-b6dc-19fae3245e0c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:20.594198 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81e58ad5-41c4-4447-b6dc-19fae3245e0c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:20.594643 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81e58ad5-41c4-4447-b6dc-19fae3245e0c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:20.595357 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81e58ad5-41c4-4447-b6dc-19fae3245e0c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:20.595815 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81e58ad5-41c4-4447-b6dc-19fae3245e0c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:20.596271 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81e58ad5-41c4-4447-b6dc-19fae3245e0c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:20.738732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-81e58ad5-41c4-4447-b6dc-19fae3245e0c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:20.748026 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-81e58ad5-41c4-4447-b6dc-19fae3245e0c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1368 microversion: 2.1 time: 0.166511 Aug 30 01:25:20.748870 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 427/850] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:20 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:21.767087 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:21.767856 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:21.773446 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8b977991-6265-4deb-8e25-fde6019698a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:21.774214 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8b977991-6265-4deb-8e25-fde6019698a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:21.783242 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b977991-6265-4deb-8e25-fde6019698a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:21.783742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b977991-6265-4deb-8e25-fde6019698a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:21.784212 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b977991-6265-4deb-8e25-fde6019698a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:21.784940 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b977991-6265-4deb-8e25-fde6019698a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:21.785398 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b977991-6265-4deb-8e25-fde6019698a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:21.785825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b977991-6265-4deb-8e25-fde6019698a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:21.853818 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-78b584b5-a0b5-44ce-800d-a791d5133d54 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:21.854411 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-78b584b5-a0b5-44ce-800d-a791d5133d54 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:21.856539 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:21.866687 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78b584b5-a0b5-44ce-800d-a791d5133d54 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:21.867470 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78b584b5-a0b5-44ce-800d-a791d5133d54 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:21.868620 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78b584b5-a0b5-44ce-800d-a791d5133d54 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:21.869665 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78b584b5-a0b5-44ce-800d-a791d5133d54 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:21.870289 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78b584b5-a0b5-44ce-800d-a791d5133d54 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:21.871039 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78b584b5-a0b5-44ce-800d-a791d5133d54 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:21.904828 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-78b584b5-a0b5-44ce-800d-a791d5133d54 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/ips" status: 200 len: 152 microversion: 2.20 time: 0.055434 Aug 30 01:25:21.906097 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 428/851] 10.222.0.44 () {60 vars in 1289 bytes} [Tue Aug 30 01:25:21 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/ips => generated 152 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:25:21.947549 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8b977991-6265-4deb-8e25-fde6019698a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:21.955659 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8b977991-6265-4deb-8e25-fde6019698a2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1368 microversion: 2.1 time: 0.189506 Aug 30 01:25:21.956248 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 424/852] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:21 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:22.977566 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-45a7c3e3-1b2b-4602-b1a0-8d43da1a1435 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:22.978128 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-45a7c3e3-1b2b-4602-b1a0-8d43da1a1435 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:22.985029 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-45a7c3e3-1b2b-4602-b1a0-8d43da1a1435 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:22.985515 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-45a7c3e3-1b2b-4602-b1a0-8d43da1a1435 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:22.985948 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-45a7c3e3-1b2b-4602-b1a0-8d43da1a1435 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:22.986642 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-45a7c3e3-1b2b-4602-b1a0-8d43da1a1435 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:22.987091 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-45a7c3e3-1b2b-4602-b1a0-8d43da1a1435 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:22.987511 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-45a7c3e3-1b2b-4602-b1a0-8d43da1a1435 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:23.129297 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-45a7c3e3-1b2b-4602-b1a0-8d43da1a1435 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:23.145676 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-45a7c3e3-1b2b-4602-b1a0-8d43da1a1435 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1558 microversion: 2.1 time: 0.172511 Aug 30 01:25:23.146391 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 429/853] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:22 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:23.167822 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-45d9dfd7-0723-4843-8654-b19e55e1864c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:23.168473 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-45d9dfd7-0723-4843-8654-b19e55e1864c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:23.175779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45d9dfd7-0723-4843-8654-b19e55e1864c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:23.176302 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45d9dfd7-0723-4843-8654-b19e55e1864c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:23.176737 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45d9dfd7-0723-4843-8654-b19e55e1864c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:23.177441 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45d9dfd7-0723-4843-8654-b19e55e1864c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:23.177914 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45d9dfd7-0723-4843-8654-b19e55e1864c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:23.178366 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45d9dfd7-0723-4843-8654-b19e55e1864c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:23.266499 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-45d9dfd7-0723-4843-8654-b19e55e1864c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102559 Aug 30 01:25:23.267116 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 425/854] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Aug 30 01:25:23 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:25:24.033282 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f8b70f2a-641b-4988-a8c1-59a2a407588f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:24.034498 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f8b70f2a-641b-4988-a8c1-59a2a407588f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:24.042030 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f8b70f2a-641b-4988-a8c1-59a2a407588f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:24.042519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f8b70f2a-641b-4988-a8c1-59a2a407588f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:24.042954 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f8b70f2a-641b-4988-a8c1-59a2a407588f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:24.043662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f8b70f2a-641b-4988-a8c1-59a2a407588f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:24.044147 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f8b70f2a-641b-4988-a8c1-59a2a407588f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:24.044574 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f8b70f2a-641b-4988-a8c1-59a2a407588f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:24.070420 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-f8b70f2a-641b-4988-a8c1-59a2a407588f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lazy-loading 'flavor' on Instance uuid 8722e41f-fb01-458b-b5c7-debe9132c196 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:25:24.265426 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f8b70f2a-641b-4988-a8c1-59a2a407588f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "POST /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/action" status: 202 len: 0 microversion: 2.20 time: 0.235942 Aug 30 01:25:24.266046 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 430/855] 10.222.0.44 () {62 vars in 1319 bytes} [Tue Aug 30 01:25:24 2022] POST /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:25:24.276940 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-23e83dc2-6a0f-4393-a9f1-0fb15a404a10 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:24.278252 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-23e83dc2-6a0f-4393-a9f1-0fb15a404a10 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:24.286354 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23e83dc2-6a0f-4393-a9f1-0fb15a404a10 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:24.287906 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23e83dc2-6a0f-4393-a9f1-0fb15a404a10 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:24.287906 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23e83dc2-6a0f-4393-a9f1-0fb15a404a10 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:24.289336 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23e83dc2-6a0f-4393-a9f1-0fb15a404a10 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:24.289950 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23e83dc2-6a0f-4393-a9f1-0fb15a404a10 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:24.290513 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23e83dc2-6a0f-4393-a9f1-0fb15a404a10 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:24.536066 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-23e83dc2-6a0f-4393-a9f1-0fb15a404a10 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:24.545500 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-23e83dc2-6a0f-4393-a9f1-0fb15a404a10 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:24.546868 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-23e83dc2-6a0f-4393-a9f1-0fb15a404a10 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:24.548088 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-23e83dc2-6a0f-4393-a9f1-0fb15a404a10 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.275337 Aug 30 01:25:24.548660 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 426/856] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:24 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:24.641705 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-ea686fbb-dac5-422e-8f4f-d09d24ace7de req-c5fdbb5e-611a-497e-a207-d0ac5b1bebf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b8c9b12-8dc1-4e3d-988c-12717b48b0b9", "tag": "4fbaf152-1777-4942-b763-c703e397257b"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:24.660656 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-ea686fbb-dac5-422e-8f4f-d09d24ace7de req-c5fdbb5e-611a-497e-a207-d0ac5b1bebf5 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:24.661419 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-ea686fbb-dac5-422e-8f4f-d09d24ace7de req-c5fdbb5e-611a-497e-a207-d0ac5b1bebf5 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:24.662206 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-ea686fbb-dac5-422e-8f4f-d09d24ace7de req-c5fdbb5e-611a-497e-a207-d0ac5b1bebf5 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:24.674307 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-ea686fbb-dac5-422e-8f4f-d09d24ace7de req-c5fdbb5e-611a-497e-a207-d0ac5b1bebf5 service nova] Creating event network-changed:4fbaf152-1777-4942-b763-c703e397257b for instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 on hv-cinder-81514 Aug 30 01:25:24.679770 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-ea686fbb-dac5-422e-8f4f-d09d24ace7de req-c5fdbb5e-611a-497e-a207-d0ac5b1bebf5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045959 Aug 30 01:25:24.680423 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 431/857] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:25:25.571660 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b1d06e06-2082-42cd-bd89-826c8f165b5b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:25.572446 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b1d06e06-2082-42cd-bd89-826c8f165b5b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:25.579625 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b1d06e06-2082-42cd-bd89-826c8f165b5b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:25.580133 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b1d06e06-2082-42cd-bd89-826c8f165b5b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:25.580567 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b1d06e06-2082-42cd-bd89-826c8f165b5b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:25.581267 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b1d06e06-2082-42cd-bd89-826c8f165b5b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:25.581739 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b1d06e06-2082-42cd-bd89-826c8f165b5b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:25.582186 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b1d06e06-2082-42cd-bd89-826c8f165b5b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:25.741111 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b1d06e06-2082-42cd-bd89-826c8f165b5b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:25.751433 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b1d06e06-2082-42cd-bd89-826c8f165b5b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:25.752939 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b1d06e06-2082-42cd-bd89-826c8f165b5b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:25.754148 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b1d06e06-2082-42cd-bd89-826c8f165b5b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.187033 Aug 30 01:25:25.764351 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 427/858] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:25 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:26.779000 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f645fb83-4a0c-443a-b102-cc36ca3529b0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:26.779704 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f645fb83-4a0c-443a-b102-cc36ca3529b0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:26.786340 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f645fb83-4a0c-443a-b102-cc36ca3529b0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:26.786824 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f645fb83-4a0c-443a-b102-cc36ca3529b0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:26.787265 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f645fb83-4a0c-443a-b102-cc36ca3529b0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:26.787957 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f645fb83-4a0c-443a-b102-cc36ca3529b0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:26.788440 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f645fb83-4a0c-443a-b102-cc36ca3529b0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:26.788869 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f645fb83-4a0c-443a-b102-cc36ca3529b0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:26.924572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f645fb83-4a0c-443a-b102-cc36ca3529b0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:26.933163 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f645fb83-4a0c-443a-b102-cc36ca3529b0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:26.934599 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f645fb83-4a0c-443a-b102-cc36ca3529b0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:26.935768 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f645fb83-4a0c-443a-b102-cc36ca3529b0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.161037 Aug 30 01:25:26.936363 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 432/859] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:26 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:27.959169 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a41dd4bd-7149-408b-b100-8590608352c0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:27.959794 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a41dd4bd-7149-408b-b100-8590608352c0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:27.962196 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:27.968230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a41dd4bd-7149-408b-b100-8590608352c0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:27.968649 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a41dd4bd-7149-408b-b100-8590608352c0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:27.969088 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a41dd4bd-7149-408b-b100-8590608352c0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:27.969783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a41dd4bd-7149-408b-b100-8590608352c0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:27.970233 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a41dd4bd-7149-408b-b100-8590608352c0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:27.970681 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a41dd4bd-7149-408b-b100-8590608352c0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:28.105896 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a41dd4bd-7149-408b-b100-8590608352c0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:28.114043 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a41dd4bd-7149-408b-b100-8590608352c0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:28.116845 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a41dd4bd-7149-408b-b100-8590608352c0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:28.118047 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a41dd4bd-7149-408b-b100-8590608352c0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.163222 Aug 30 01:25:28.118621 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 428/860] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:27 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:29.141063 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bd9c3e09-ad21-42aa-86e7-000c994b3272 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:29.141703 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bd9c3e09-ad21-42aa-86e7-000c994b3272 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:29.149179 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd9c3e09-ad21-42aa-86e7-000c994b3272 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:29.149668 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd9c3e09-ad21-42aa-86e7-000c994b3272 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:29.150105 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd9c3e09-ad21-42aa-86e7-000c994b3272 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:29.150803 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd9c3e09-ad21-42aa-86e7-000c994b3272 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:29.151257 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd9c3e09-ad21-42aa-86e7-000c994b3272 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:29.151680 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd9c3e09-ad21-42aa-86e7-000c994b3272 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:29.282489 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bd9c3e09-ad21-42aa-86e7-000c994b3272 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:29.290562 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bd9c3e09-ad21-42aa-86e7-000c994b3272 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:29.292014 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bd9c3e09-ad21-42aa-86e7-000c994b3272 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:29.293185 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bd9c3e09-ad21-42aa-86e7-000c994b3272 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.156264 Aug 30 01:25:29.293737 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 433/861] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:29 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:30.316467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2fcbe78b-dd9f-4112-aa8f-2cd069c88156 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:30.317083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2fcbe78b-dd9f-4112-aa8f-2cd069c88156 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:30.323915 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2fcbe78b-dd9f-4112-aa8f-2cd069c88156 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:30.324597 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2fcbe78b-dd9f-4112-aa8f-2cd069c88156 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:30.325384 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2fcbe78b-dd9f-4112-aa8f-2cd069c88156 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:30.326637 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2fcbe78b-dd9f-4112-aa8f-2cd069c88156 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:30.327116 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2fcbe78b-dd9f-4112-aa8f-2cd069c88156 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:30.327550 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2fcbe78b-dd9f-4112-aa8f-2cd069c88156 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:30.460198 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2fcbe78b-dd9f-4112-aa8f-2cd069c88156 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:30.468180 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2fcbe78b-dd9f-4112-aa8f-2cd069c88156 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:30.469606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2fcbe78b-dd9f-4112-aa8f-2cd069c88156 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:30.470754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2fcbe78b-dd9f-4112-aa8f-2cd069c88156 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.158257 Aug 30 01:25:30.471303 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 429/862] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:30 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:31.493881 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5a99d59f-f839-4d6e-a301-8a5bfb029129 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:31.494488 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5a99d59f-f839-4d6e-a301-8a5bfb029129 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:31.500988 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5a99d59f-f839-4d6e-a301-8a5bfb029129 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:31.501470 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5a99d59f-f839-4d6e-a301-8a5bfb029129 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:31.501904 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5a99d59f-f839-4d6e-a301-8a5bfb029129 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:31.502589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5a99d59f-f839-4d6e-a301-8a5bfb029129 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:31.503039 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5a99d59f-f839-4d6e-a301-8a5bfb029129 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:31.503456 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5a99d59f-f839-4d6e-a301-8a5bfb029129 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:31.632639 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5a99d59f-f839-4d6e-a301-8a5bfb029129 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:31.640624 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5a99d59f-f839-4d6e-a301-8a5bfb029129 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:31.642070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5a99d59f-f839-4d6e-a301-8a5bfb029129 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:31.643220 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5a99d59f-f839-4d6e-a301-8a5bfb029129 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.153284 Aug 30 01:25:31.643779 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 434/863] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:31 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:32.673117 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d80d9df2-c666-45a9-9013-c3881a74035b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:32.673670 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d80d9df2-c666-45a9-9013-c3881a74035b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:32.681003 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d80d9df2-c666-45a9-9013-c3881a74035b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:32.681486 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d80d9df2-c666-45a9-9013-c3881a74035b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:32.681929 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d80d9df2-c666-45a9-9013-c3881a74035b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:32.682626 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d80d9df2-c666-45a9-9013-c3881a74035b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:32.683080 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d80d9df2-c666-45a9-9013-c3881a74035b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:32.683505 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d80d9df2-c666-45a9-9013-c3881a74035b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:32.812354 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d80d9df2-c666-45a9-9013-c3881a74035b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:32.821227 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d80d9df2-c666-45a9-9013-c3881a74035b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:32.822668 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d80d9df2-c666-45a9-9013-c3881a74035b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:32.823832 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d80d9df2-c666-45a9-9013-c3881a74035b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.154830 Aug 30 01:25:32.824490 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 430/864] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:32 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:33.847981 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7e2de9c9-d32b-4220-b5d4-486113744916 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:33.848672 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7e2de9c9-d32b-4220-b5d4-486113744916 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:33.855552 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7e2de9c9-d32b-4220-b5d4-486113744916 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:33.856051 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7e2de9c9-d32b-4220-b5d4-486113744916 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:33.856482 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7e2de9c9-d32b-4220-b5d4-486113744916 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:33.857161 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7e2de9c9-d32b-4220-b5d4-486113744916 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:33.857603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7e2de9c9-d32b-4220-b5d4-486113744916 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:33.858020 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7e2de9c9-d32b-4220-b5d4-486113744916 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:33.994813 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7e2de9c9-d32b-4220-b5d4-486113744916 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:33.998400 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:34.004192 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7e2de9c9-d32b-4220-b5d4-486113744916 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:34.006999 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7e2de9c9-d32b-4220-b5d4-486113744916 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:34.008198 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7e2de9c9-d32b-4220-b5d4-486113744916 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.164389 Aug 30 01:25:34.008765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 435/865] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:33 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:35.031422 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6bcc9241-6c39-4ac8-994e-7508cff0ccbf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:35.032043 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6bcc9241-6c39-4ac8-994e-7508cff0ccbf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:35.039621 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bcc9241-6c39-4ac8-994e-7508cff0ccbf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:35.040144 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bcc9241-6c39-4ac8-994e-7508cff0ccbf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:35.040586 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bcc9241-6c39-4ac8-994e-7508cff0ccbf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:35.041438 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bcc9241-6c39-4ac8-994e-7508cff0ccbf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:35.041898 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bcc9241-6c39-4ac8-994e-7508cff0ccbf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:35.042336 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6bcc9241-6c39-4ac8-994e-7508cff0ccbf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:35.177466 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6bcc9241-6c39-4ac8-994e-7508cff0ccbf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:35.185598 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6bcc9241-6c39-4ac8-994e-7508cff0ccbf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:35.187054 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6bcc9241-6c39-4ac8-994e-7508cff0ccbf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:35.188250 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6bcc9241-6c39-4ac8-994e-7508cff0ccbf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.160900 Aug 30 01:25:35.188804 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 431/866] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:35 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:36.210771 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3b2fa697-c1a3-4049-bdb2-8275dec4916d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:36.211395 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3b2fa697-c1a3-4049-bdb2-8275dec4916d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:36.218973 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b2fa697-c1a3-4049-bdb2-8275dec4916d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:36.219456 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b2fa697-c1a3-4049-bdb2-8275dec4916d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:36.219895 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b2fa697-c1a3-4049-bdb2-8275dec4916d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:36.220622 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b2fa697-c1a3-4049-bdb2-8275dec4916d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:36.221075 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b2fa697-c1a3-4049-bdb2-8275dec4916d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:36.222207 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b2fa697-c1a3-4049-bdb2-8275dec4916d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:36.353717 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3b2fa697-c1a3-4049-bdb2-8275dec4916d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:36.362041 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3b2fa697-c1a3-4049-bdb2-8275dec4916d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:36.363462 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3b2fa697-c1a3-4049-bdb2-8275dec4916d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:36.365271 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3b2fa697-c1a3-4049-bdb2-8275dec4916d tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.157792 Aug 30 01:25:36.365823 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 436/867] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:36 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:37.389712 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-47329728-1b80-47ec-9af1-6d89ed673019 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:37.390236 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-47329728-1b80-47ec-9af1-6d89ed673019 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:37.397322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47329728-1b80-47ec-9af1-6d89ed673019 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:37.397799 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47329728-1b80-47ec-9af1-6d89ed673019 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:37.398235 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47329728-1b80-47ec-9af1-6d89ed673019 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:37.398925 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47329728-1b80-47ec-9af1-6d89ed673019 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:37.399377 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47329728-1b80-47ec-9af1-6d89ed673019 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:37.399798 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47329728-1b80-47ec-9af1-6d89ed673019 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:37.530662 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-47329728-1b80-47ec-9af1-6d89ed673019 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:37.538794 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-47329728-1b80-47ec-9af1-6d89ed673019 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:37.540164 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-47329728-1b80-47ec-9af1-6d89ed673019 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:37.541319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-47329728-1b80-47ec-9af1-6d89ed673019 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.155614 Aug 30 01:25:37.541872 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 432/868] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:37 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:38.564264 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9168c093-185c-47be-b015-b0e8ac8fbf21 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:38.564845 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9168c093-185c-47be-b015-b0e8ac8fbf21 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:38.571717 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9168c093-185c-47be-b015-b0e8ac8fbf21 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:38.572232 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9168c093-185c-47be-b015-b0e8ac8fbf21 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:38.572669 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9168c093-185c-47be-b015-b0e8ac8fbf21 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:38.573336 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9168c093-185c-47be-b015-b0e8ac8fbf21 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:38.573778 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9168c093-185c-47be-b015-b0e8ac8fbf21 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:38.574196 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9168c093-185c-47be-b015-b0e8ac8fbf21 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:38.703129 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9168c093-185c-47be-b015-b0e8ac8fbf21 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:38.712456 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9168c093-185c-47be-b015-b0e8ac8fbf21 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:38.714130 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9168c093-185c-47be-b015-b0e8ac8fbf21 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:38.715043 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9168c093-185c-47be-b015-b0e8ac8fbf21 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.154700 Aug 30 01:25:38.715593 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 437/869] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:38 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:39.738238 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3442a8c4-0b04-40dc-8591-9633c894eaee tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:39.738857 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3442a8c4-0b04-40dc-8591-9633c894eaee tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:39.745444 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3442a8c4-0b04-40dc-8591-9633c894eaee tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:39.745928 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3442a8c4-0b04-40dc-8591-9633c894eaee tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:39.746363 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3442a8c4-0b04-40dc-8591-9633c894eaee tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:39.747057 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3442a8c4-0b04-40dc-8591-9633c894eaee tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:39.747511 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3442a8c4-0b04-40dc-8591-9633c894eaee tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:39.747935 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3442a8c4-0b04-40dc-8591-9633c894eaee tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:39.884187 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3442a8c4-0b04-40dc-8591-9633c894eaee tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:39.892871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3442a8c4-0b04-40dc-8591-9633c894eaee tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:39.894409 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3442a8c4-0b04-40dc-8591-9633c894eaee tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:39.896321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3442a8c4-0b04-40dc-8591-9633c894eaee tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.161263 Aug 30 01:25:39.896998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 433/870] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:39 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:40.929513 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-82cb2513-33fe-4ed3-8e3d-855473c005fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:40.930113 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-82cb2513-33fe-4ed3-8e3d-855473c005fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:40.936505 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-82cb2513-33fe-4ed3-8e3d-855473c005fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:40.936667 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-82cb2513-33fe-4ed3-8e3d-855473c005fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:40.937103 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-82cb2513-33fe-4ed3-8e3d-855473c005fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:40.937789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-82cb2513-33fe-4ed3-8e3d-855473c005fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:40.938235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-82cb2513-33fe-4ed3-8e3d-855473c005fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:40.938652 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-82cb2513-33fe-4ed3-8e3d-855473c005fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:41.070221 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-82cb2513-33fe-4ed3-8e3d-855473c005fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:41.078096 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-82cb2513-33fe-4ed3-8e3d-855473c005fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:41.079507 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-82cb2513-33fe-4ed3-8e3d-855473c005fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:41.080675 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-82cb2513-33fe-4ed3-8e3d-855473c005fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1744 microversion: 2.20 time: 0.155774 Aug 30 01:25:41.081223 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 438/871] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:40 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:42.104253 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4cc7ba3f-a238-4a16-babf-7503e80c9889 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:42.104912 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4cc7ba3f-a238-4a16-babf-7503e80c9889 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:42.111545 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4cc7ba3f-a238-4a16-babf-7503e80c9889 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:42.112059 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4cc7ba3f-a238-4a16-babf-7503e80c9889 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:42.112503 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4cc7ba3f-a238-4a16-babf-7503e80c9889 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:42.113212 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4cc7ba3f-a238-4a16-babf-7503e80c9889 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:42.113675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4cc7ba3f-a238-4a16-babf-7503e80c9889 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:42.114593 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4cc7ba3f-a238-4a16-babf-7503e80c9889 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:42.245473 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4cc7ba3f-a238-4a16-babf-7503e80c9889 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:42.253774 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4cc7ba3f-a238-4a16-babf-7503e80c9889 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:42.256421 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4cc7ba3f-a238-4a16-babf-7503e80c9889 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:42.257732 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4cc7ba3f-a238-4a16-babf-7503e80c9889 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1744 microversion: 2.20 time: 0.157880 Aug 30 01:25:42.258417 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 434/872] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:42 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:43.280781 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-14ea7c8a-6592-47c4-b381-7e14f31814c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:43.281680 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-14ea7c8a-6592-47c4-b381-7e14f31814c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:43.288866 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-14ea7c8a-6592-47c4-b381-7e14f31814c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:43.289358 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-14ea7c8a-6592-47c4-b381-7e14f31814c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:43.289798 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-14ea7c8a-6592-47c4-b381-7e14f31814c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:43.290496 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-14ea7c8a-6592-47c4-b381-7e14f31814c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:43.290952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-14ea7c8a-6592-47c4-b381-7e14f31814c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:43.291408 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-14ea7c8a-6592-47c4-b381-7e14f31814c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:43.434496 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-14ea7c8a-6592-47c4-b381-7e14f31814c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:43.444413 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-14ea7c8a-6592-47c4-b381-7e14f31814c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:43.445977 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-14ea7c8a-6592-47c4-b381-7e14f31814c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:43.447147 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-14ea7c8a-6592-47c4-b381-7e14f31814c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1739 microversion: 2.20 time: 0.170250 Aug 30 01:25:43.447696 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 439/873] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:43 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:44.140074 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-2114bb36-c30d-4710-bd91-b19630a5fe06 req-e87fc506-ab5e-457b-90e6-a96f55190bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8722e41f-fb01-458b-b5c7-debe9132c196", "name": "network-vif-plugged", "status": "completed", "tag": "c49d906b-0426-46ea-a3fc-7b2c2024e265"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:44.152833 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2114bb36-c30d-4710-bd91-b19630a5fe06 req-e87fc506-ab5e-457b-90e6-a96f55190bef service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:44.153780 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2114bb36-c30d-4710-bd91-b19630a5fe06 req-e87fc506-ab5e-457b-90e6-a96f55190bef service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:44.154447 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2114bb36-c30d-4710-bd91-b19630a5fe06 req-e87fc506-ab5e-457b-90e6-a96f55190bef service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:44.161965 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=89 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:44.171348 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-2114bb36-c30d-4710-bd91-b19630a5fe06 req-e87fc506-ab5e-457b-90e6-a96f55190bef service nova] Creating event network-vif-plugged:c49d906b-0426-46ea-a3fc-7b2c2024e265 for instance 8722e41f-fb01-458b-b5c7-debe9132c196 on hv-cinder-81514 Aug 30 01:25:44.180335 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-2114bb36-c30d-4710-bd91-b19630a5fe06 req-e87fc506-ab5e-457b-90e6-a96f55190bef service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043740 Aug 30 01:25:44.181291 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 435/874] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:25:44.470974 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ff36dd48-7b6c-4923-b0b3-9999c34dc619 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:44.471688 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ff36dd48-7b6c-4923-b0b3-9999c34dc619 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:44.479839 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff36dd48-7b6c-4923-b0b3-9999c34dc619 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:44.481086 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff36dd48-7b6c-4923-b0b3-9999c34dc619 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:44.482568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff36dd48-7b6c-4923-b0b3-9999c34dc619 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:44.483672 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff36dd48-7b6c-4923-b0b3-9999c34dc619 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:44.484158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff36dd48-7b6c-4923-b0b3-9999c34dc619 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:44.484589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff36dd48-7b6c-4923-b0b3-9999c34dc619 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:44.640410 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ff36dd48-7b6c-4923-b0b3-9999c34dc619 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:44.649171 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ff36dd48-7b6c-4923-b0b3-9999c34dc619 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:44.650764 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ff36dd48-7b6c-4923-b0b3-9999c34dc619 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:44.651985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ff36dd48-7b6c-4923-b0b3-9999c34dc619 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1739 microversion: 2.20 time: 0.184945 Aug 30 01:25:44.652572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 440/875] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:44 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:45.680994 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2984b7c7-3943-4451-97f3-1ae990a5b8e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:45.681866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2984b7c7-3943-4451-97f3-1ae990a5b8e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:45.689317 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2984b7c7-3943-4451-97f3-1ae990a5b8e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:45.690105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2984b7c7-3943-4451-97f3-1ae990a5b8e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:45.690734 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2984b7c7-3943-4451-97f3-1ae990a5b8e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:45.691745 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2984b7c7-3943-4451-97f3-1ae990a5b8e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:45.693562 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2984b7c7-3943-4451-97f3-1ae990a5b8e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:45.694504 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2984b7c7-3943-4451-97f3-1ae990a5b8e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:45.854401 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2984b7c7-3943-4451-97f3-1ae990a5b8e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:45.863113 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2984b7c7-3943-4451-97f3-1ae990a5b8e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:45.865238 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2984b7c7-3943-4451-97f3-1ae990a5b8e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:45.866623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2984b7c7-3943-4451-97f3-1ae990a5b8e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1739 microversion: 2.20 time: 0.192720 Aug 30 01:25:45.884671 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 436/876] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:45 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:46.894196 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-56071359-229d-4911-b07b-ee85be627851 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:46.894950 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-56071359-229d-4911-b07b-ee85be627851 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:46.901663 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56071359-229d-4911-b07b-ee85be627851 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:46.902162 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56071359-229d-4911-b07b-ee85be627851 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:46.902597 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56071359-229d-4911-b07b-ee85be627851 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:46.903297 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56071359-229d-4911-b07b-ee85be627851 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:46.903750 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56071359-229d-4911-b07b-ee85be627851 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:46.904202 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56071359-229d-4911-b07b-ee85be627851 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:47.229495 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-56071359-229d-4911-b07b-ee85be627851 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:47.239151 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-56071359-229d-4911-b07b-ee85be627851 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:47.240894 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-56071359-229d-4911-b07b-ee85be627851 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:47.242458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-56071359-229d-4911-b07b-ee85be627851 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1739 microversion: 2.20 time: 0.354023 Aug 30 01:25:47.251303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 441/877] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:46 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1739 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:48.273691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e5156d48-1867-4142-981c-c54921376974 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:48.274821 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e5156d48-1867-4142-981c-c54921376974 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:48.295638 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5156d48-1867-4142-981c-c54921376974 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:48.296367 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5156d48-1867-4142-981c-c54921376974 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:48.297005 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5156d48-1867-4142-981c-c54921376974 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:48.307554 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5156d48-1867-4142-981c-c54921376974 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:48.308345 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5156d48-1867-4142-981c-c54921376974 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:48.308923 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5156d48-1867-4142-981c-c54921376974 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:48.496349 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e5156d48-1867-4142-981c-c54921376974 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:48.507435 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e5156d48-1867-4142-981c-c54921376974 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:48.509021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e5156d48-1867-4142-981c-c54921376974 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:48.510288 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e5156d48-1867-4142-981c-c54921376974 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1739 microversion: 2.20 time: 0.244844 Aug 30 01:25:48.511251 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 437/878] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:48 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:49.533361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0750ce83-9ddb-40ed-9cff-f02457256997 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:49.533986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0750ce83-9ddb-40ed-9cff-f02457256997 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:49.540952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0750ce83-9ddb-40ed-9cff-f02457256997 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:49.541453 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0750ce83-9ddb-40ed-9cff-f02457256997 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:49.541905 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0750ce83-9ddb-40ed-9cff-f02457256997 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:49.542629 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0750ce83-9ddb-40ed-9cff-f02457256997 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:49.543076 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0750ce83-9ddb-40ed-9cff-f02457256997 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:49.543491 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0750ce83-9ddb-40ed-9cff-f02457256997 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:49.698454 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0750ce83-9ddb-40ed-9cff-f02457256997 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:49.709868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0750ce83-9ddb-40ed-9cff-f02457256997 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:49.711318 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0750ce83-9ddb-40ed-9cff-f02457256997 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:49.712713 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0750ce83-9ddb-40ed-9cff-f02457256997 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1739 microversion: 2.20 time: 0.182949 Aug 30 01:25:49.722972 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 442/879] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:49 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:50.736499 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-26b27cd9-d468-43d8-8258-ad2bc4306531 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:50.738187 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-26b27cd9-d468-43d8-8258-ad2bc4306531 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:50.743862 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-26b27cd9-d468-43d8-8258-ad2bc4306531 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:50.744449 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-26b27cd9-d468-43d8-8258-ad2bc4306531 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:50.744975 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-26b27cd9-d468-43d8-8258-ad2bc4306531 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:50.745752 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-26b27cd9-d468-43d8-8258-ad2bc4306531 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:50.746281 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-26b27cd9-d468-43d8-8258-ad2bc4306531 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:50.746774 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-26b27cd9-d468-43d8-8258-ad2bc4306531 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:50.893422 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-26b27cd9-d468-43d8-8258-ad2bc4306531 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:50.904951 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-26b27cd9-d468-43d8-8258-ad2bc4306531 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:50.906694 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-26b27cd9-d468-43d8-8258-ad2bc4306531 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:50.907870 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-26b27cd9-d468-43d8-8258-ad2bc4306531 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1739 microversion: 2.20 time: 0.175745 Aug 30 01:25:50.911016 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 438/880] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:50 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:51.931436 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-687b9736-b4d4-47e7-8716-27b5eb3e896b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:51.932423 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-687b9736-b4d4-47e7-8716-27b5eb3e896b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:51.934596 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=31 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:51.940322 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-687b9736-b4d4-47e7-8716-27b5eb3e896b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:51.940905 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-687b9736-b4d4-47e7-8716-27b5eb3e896b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:51.942170 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-687b9736-b4d4-47e7-8716-27b5eb3e896b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:51.942502 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-687b9736-b4d4-47e7-8716-27b5eb3e896b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:51.942968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-687b9736-b4d4-47e7-8716-27b5eb3e896b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:51.943388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-687b9736-b4d4-47e7-8716-27b5eb3e896b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:52.082319 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-687b9736-b4d4-47e7-8716-27b5eb3e896b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:52.090476 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-687b9736-b4d4-47e7-8716-27b5eb3e896b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:52.091914 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-687b9736-b4d4-47e7-8716-27b5eb3e896b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:52.093101 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-687b9736-b4d4-47e7-8716-27b5eb3e896b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1739 microversion: 2.20 time: 0.165845 Aug 30 01:25:52.093640 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 443/881] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:51 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:53.118348 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-37705333-2437-41e0-a0ee-6281326545f0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:53.118963 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-37705333-2437-41e0-a0ee-6281326545f0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:53.125120 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37705333-2437-41e0-a0ee-6281326545f0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:53.125606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37705333-2437-41e0-a0ee-6281326545f0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:53.126045 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37705333-2437-41e0-a0ee-6281326545f0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:53.126745 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37705333-2437-41e0-a0ee-6281326545f0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:53.127198 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37705333-2437-41e0-a0ee-6281326545f0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:53.127625 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37705333-2437-41e0-a0ee-6281326545f0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:53.282957 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-37705333-2437-41e0-a0ee-6281326545f0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:53.291932 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-37705333-2437-41e0-a0ee-6281326545f0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:53.293393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-37705333-2437-41e0-a0ee-6281326545f0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:53.294561 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-37705333-2437-41e0-a0ee-6281326545f0 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1721 microversion: 2.20 time: 0.180705 Aug 30 01:25:53.295137 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 439/882] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:53 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:25:54.318444 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5fda1ed7-c4d3-4b3e-ab44-7948a8382ccf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:54.319117 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5fda1ed7-c4d3-4b3e-ab44-7948a8382ccf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:54.325569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5fda1ed7-c4d3-4b3e-ab44-7948a8382ccf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:54.326054 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5fda1ed7-c4d3-4b3e-ab44-7948a8382ccf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:54.326487 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5fda1ed7-c4d3-4b3e-ab44-7948a8382ccf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:54.327173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5fda1ed7-c4d3-4b3e-ab44-7948a8382ccf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:54.327626 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5fda1ed7-c4d3-4b3e-ab44-7948a8382ccf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:54.328077 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5fda1ed7-c4d3-4b3e-ab44-7948a8382ccf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:54.459777 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5fda1ed7-c4d3-4b3e-ab44-7948a8382ccf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:54.467863 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5fda1ed7-c4d3-4b3e-ab44-7948a8382ccf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:54.469332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5fda1ed7-c4d3-4b3e-ab44-7948a8382ccf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:54.470490 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5fda1ed7-c4d3-4b3e-ab44-7948a8382ccf tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1721 microversion: 2.20 time: 0.156752 Aug 30 01:25:54.471039 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 444/883] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:54 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:55.494737 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d9af9300-b1ec-4e2d-b2dd-629d3f4a0dc7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:55.495366 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d9af9300-b1ec-4e2d-b2dd-629d3f4a0dc7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:55.501986 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d9af9300-b1ec-4e2d-b2dd-629d3f4a0dc7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:55.502467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d9af9300-b1ec-4e2d-b2dd-629d3f4a0dc7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:55.502905 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d9af9300-b1ec-4e2d-b2dd-629d3f4a0dc7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:55.504298 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d9af9300-b1ec-4e2d-b2dd-629d3f4a0dc7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:55.504759 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d9af9300-b1ec-4e2d-b2dd-629d3f4a0dc7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:55.505191 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d9af9300-b1ec-4e2d-b2dd-629d3f4a0dc7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:55.634272 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d9af9300-b1ec-4e2d-b2dd-629d3f4a0dc7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:55.642372 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d9af9300-b1ec-4e2d-b2dd-629d3f4a0dc7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:55.643985 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d9af9300-b1ec-4e2d-b2dd-629d3f4a0dc7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:55.645185 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d9af9300-b1ec-4e2d-b2dd-629d3f4a0dc7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1664 microversion: 2.20 time: 0.154391 Aug 30 01:25:55.645748 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 440/884] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:55 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:55.668529 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3250408a-2739-4c03-bc99-4ce7a08624a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28938921-51aa-4816-bacb-640f6a8e4882"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:55.670962 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3250408a-2739-4c03-bc99-4ce7a08624a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:55.678045 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3250408a-2739-4c03-bc99-4ce7a08624a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:55.678525 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3250408a-2739-4c03-bc99-4ce7a08624a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:55.678958 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3250408a-2739-4c03-bc99-4ce7a08624a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:55.679648 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3250408a-2739-4c03-bc99-4ce7a08624a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:55.680136 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3250408a-2739-4c03-bc99-4ce7a08624a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:55.680556 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3250408a-2739-4c03-bc99-4ce7a08624a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:55.949091 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3250408a-2739-4c03-bc99-4ce7a08624a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "POST /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.284591 Aug 30 01:25:55.949793 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 445/885] 10.222.0.44 () {62 vars in 1364 bytes} [Tue Aug 30 01:25:55 2022] POST /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/os-volume_attachments => generated 188 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:25:56.071081 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e189e199-2c3f-4097-9175-abfde335d32b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:56.071594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e189e199-2c3f-4097-9175-abfde335d32b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:56.078650 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e189e199-2c3f-4097-9175-abfde335d32b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:56.079133 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e189e199-2c3f-4097-9175-abfde335d32b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:56.080075 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e189e199-2c3f-4097-9175-abfde335d32b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:56.080309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e189e199-2c3f-4097-9175-abfde335d32b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:56.080755 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e189e199-2c3f-4097-9175-abfde335d32b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:56.081227 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e189e199-2c3f-4097-9175-abfde335d32b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:56.196763 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-88ad41e1-27bc-4463-a402-4e679f0bbac1 req-20e416c3-32b5-4cc8-8d8a-86597c62e93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8722e41f-fb01-458b-b5c7-debe9132c196", "name": "network-vif-unplugged", "status": "completed", "tag": "c49d906b-0426-46ea-a3fc-7b2c2024e265"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:56.208792 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-88ad41e1-27bc-4463-a402-4e679f0bbac1 req-20e416c3-32b5-4cc8-8d8a-86597c62e93f service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:56.209112 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-88ad41e1-27bc-4463-a402-4e679f0bbac1 req-20e416c3-32b5-4cc8-8d8a-86597c62e93f service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:56.209484 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-88ad41e1-27bc-4463-a402-4e679f0bbac1 req-20e416c3-32b5-4cc8-8d8a-86597c62e93f service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:56.226876 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.compute.server_external_events [req-88ad41e1-27bc-4463-a402-4e679f0bbac1 req-20e416c3-32b5-4cc8-8d8a-86597c62e93f service nova] Unable to find a host for instance 8722e41f-fb01-458b-b5c7-debe9132c196. Dropping event network-vif-unplugged {{(pid=120705) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 01:25:56.228064 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-88ad41e1-27bc-4463-a402-4e679f0bbac1 req-20e416c3-32b5-4cc8-8d8a-86597c62e93f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035061 Aug 30 01:25:56.228947 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 446/886] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 01:25:56.354870 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e189e199-2c3f-4097-9175-abfde335d32b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/os-volume_attachments/28938921-51aa-4816-bacb-640f6a8e4882" status: 202 len: 0 microversion: 2.20 time: 0.287820 Aug 30 01:25:56.355446 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 441/887] 10.222.0.44 () {60 vars in 1457 bytes} [Tue Aug 30 01:25:56 2022] DELETE /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/os-volume_attachments/28938921-51aa-4816-bacb-640f6a8e4882 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:25:56.416857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-79a81804-86b7-4eb2-a68a-85fa953efa08 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:56.417453 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-79a81804-86b7-4eb2-a68a-85fa953efa08 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:56.423358 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79a81804-86b7-4eb2-a68a-85fa953efa08 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:56.423843 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79a81804-86b7-4eb2-a68a-85fa953efa08 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:56.424333 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79a81804-86b7-4eb2-a68a-85fa953efa08 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:56.425195 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79a81804-86b7-4eb2-a68a-85fa953efa08 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:56.425895 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79a81804-86b7-4eb2-a68a-85fa953efa08 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:56.426328 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79a81804-86b7-4eb2-a68a-85fa953efa08 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:56.457357 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-79a81804-86b7-4eb2-a68a-85fa953efa08 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120705) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 01:25:56.525080 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-79a81804-86b7-4eb2-a68a-85fa953efa08 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "POST /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/action" status: 202 len: 0 microversion: 2.20 time: 0.112362 Aug 30 01:25:56.525601 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 447/888] 10.222.0.44 () {62 vars in 1319 bytes} [Tue Aug 30 01:25:56 2022] POST /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:25:56.533955 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7ae8603a-f2ec-41d5-a405-7b96f13274fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:56.535359 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7ae8603a-f2ec-41d5-a405-7b96f13274fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:56.543988 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ae8603a-f2ec-41d5-a405-7b96f13274fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:56.544510 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ae8603a-f2ec-41d5-a405-7b96f13274fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:56.544946 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ae8603a-f2ec-41d5-a405-7b96f13274fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:56.545643 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ae8603a-f2ec-41d5-a405-7b96f13274fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:56.546092 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ae8603a-f2ec-41d5-a405-7b96f13274fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:56.546555 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ae8603a-f2ec-41d5-a405-7b96f13274fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:56.686614 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7ae8603a-f2ec-41d5-a405-7b96f13274fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:56.697265 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7ae8603a-f2ec-41d5-a405-7b96f13274fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:56.698828 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7ae8603a-f2ec-41d5-a405-7b96f13274fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:56.700020 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7ae8603a-f2ec-41d5-a405-7b96f13274fb tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1672 microversion: 2.20 time: 0.170088 Aug 30 01:25:56.700580 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 442/889] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:56 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:57.725388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-606303e1-a564-404e-801d-3d172dbc3d64 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:57.725999 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-606303e1-a564-404e-801d-3d172dbc3d64 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:57.732509 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-606303e1-a564-404e-801d-3d172dbc3d64 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:57.732993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-606303e1-a564-404e-801d-3d172dbc3d64 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:57.733431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-606303e1-a564-404e-801d-3d172dbc3d64 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:57.734120 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-606303e1-a564-404e-801d-3d172dbc3d64 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:57.734571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-606303e1-a564-404e-801d-3d172dbc3d64 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:57.734994 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-606303e1-a564-404e-801d-3d172dbc3d64 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:57.864621 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-606303e1-a564-404e-801d-3d172dbc3d64 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:57.872623 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-606303e1-a564-404e-801d-3d172dbc3d64 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:57.874049 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-606303e1-a564-404e-801d-3d172dbc3d64 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:57.875201 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-606303e1-a564-404e-801d-3d172dbc3d64 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.154270 Aug 30 01:25:57.875822 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 448/890] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:57 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:25:58.898751 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-45966627-0677-4ca0-9fb8-38c698ffc943 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:58.899839 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-45966627-0677-4ca0-9fb8-38c698ffc943 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:58.905806 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=30 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:58.913425 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45966627-0677-4ca0-9fb8-38c698ffc943 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:58.921521 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45966627-0677-4ca0-9fb8-38c698ffc943 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:58.923303 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45966627-0677-4ca0-9fb8-38c698ffc943 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:58.926739 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45966627-0677-4ca0-9fb8-38c698ffc943 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:58.928647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45966627-0677-4ca0-9fb8-38c698ffc943 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:58.929961 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45966627-0677-4ca0-9fb8-38c698ffc943 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:59.168442 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-45966627-0677-4ca0-9fb8-38c698ffc943 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:59.177874 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-45966627-0677-4ca0-9fb8-38c698ffc943 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:59.179320 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-45966627-0677-4ca0-9fb8-38c698ffc943 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:59.180550 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-45966627-0677-4ca0-9fb8-38c698ffc943 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.285781 Aug 30 01:25:59.181105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 443/891] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:25:58 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:26:00.206331 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1e0a73e3-488d-4510-aaba-3b77f7dcd9a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:00.207709 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1e0a73e3-488d-4510-aaba-3b77f7dcd9a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:00.221944 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e0a73e3-488d-4510-aaba-3b77f7dcd9a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:00.222700 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e0a73e3-488d-4510-aaba-3b77f7dcd9a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:00.223049 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e0a73e3-488d-4510-aaba-3b77f7dcd9a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:00.228603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e0a73e3-488d-4510-aaba-3b77f7dcd9a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:00.229165 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e0a73e3-488d-4510-aaba-3b77f7dcd9a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:00.229727 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e0a73e3-488d-4510-aaba-3b77f7dcd9a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:00.261453 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:00.375277 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1e0a73e3-488d-4510-aaba-3b77f7dcd9a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:00.384227 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1e0a73e3-488d-4510-aaba-3b77f7dcd9a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:00.385668 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1e0a73e3-488d-4510-aaba-3b77f7dcd9a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:00.386838 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1e0a73e3-488d-4510-aaba-3b77f7dcd9a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.185944 Aug 30 01:26:00.387399 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 449/892] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:00 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:26:00.974388 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-496e9488-b1a2-4f0b-8347-c1db80964d4b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:00.974917 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-496e9488-b1a2-4f0b-8347-c1db80964d4b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:00.981616 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-496e9488-b1a2-4f0b-8347-c1db80964d4b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:00.982095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-496e9488-b1a2-4f0b-8347-c1db80964d4b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:00.982527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-496e9488-b1a2-4f0b-8347-c1db80964d4b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:00.983210 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-496e9488-b1a2-4f0b-8347-c1db80964d4b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:00.983657 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-496e9488-b1a2-4f0b-8347-c1db80964d4b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:00.984108 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-496e9488-b1a2-4f0b-8347-c1db80964d4b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:01.008266 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-496e9488-b1a2-4f0b-8347-c1db80964d4b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/ips" status: 200 len: 150 microversion: 2.1 time: 0.037788 Aug 30 01:26:01.008848 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 444/893] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Aug 30 01:26:00 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:01.410985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bc97258a-7d76-407c-a218-47b8733bbb52 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:01.411591 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bc97258a-7d76-407c-a218-47b8733bbb52 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:01.417946 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc97258a-7d76-407c-a218-47b8733bbb52 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:01.418429 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc97258a-7d76-407c-a218-47b8733bbb52 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:01.418864 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc97258a-7d76-407c-a218-47b8733bbb52 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:01.419555 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc97258a-7d76-407c-a218-47b8733bbb52 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:01.420189 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc97258a-7d76-407c-a218-47b8733bbb52 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:01.420621 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc97258a-7d76-407c-a218-47b8733bbb52 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:01.569690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bc97258a-7d76-407c-a218-47b8733bbb52 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:01.578004 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bc97258a-7d76-407c-a218-47b8733bbb52 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:01.579435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bc97258a-7d76-407c-a218-47b8733bbb52 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:01.581201 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bc97258a-7d76-407c-a218-47b8733bbb52 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.174047 Aug 30 01:26:01.581755 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 450/894] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:01 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:26:02.378698 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9501d5c3-ed96-4779-a806-ae5861f62e77 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f257c1f-f45c-4454-87f6-afd886240e76"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:02.381203 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9501d5c3-ed96-4779-a806-ae5861f62e77 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:02.388250 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9501d5c3-ed96-4779-a806-ae5861f62e77 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:02.388736 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9501d5c3-ed96-4779-a806-ae5861f62e77 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:02.389174 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9501d5c3-ed96-4779-a806-ae5861f62e77 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:02.389884 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9501d5c3-ed96-4779-a806-ae5861f62e77 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:02.390337 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9501d5c3-ed96-4779-a806-ae5861f62e77 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:02.390760 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9501d5c3-ed96-4779-a806-ae5861f62e77 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:02.603082 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e8d0e8b2-3d22-4ed8-b4d9-26dd80eb4abd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:02.603624 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e8d0e8b2-3d22-4ed8-b4d9-26dd80eb4abd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:02.609981 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e8d0e8b2-3d22-4ed8-b4d9-26dd80eb4abd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:02.610455 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e8d0e8b2-3d22-4ed8-b4d9-26dd80eb4abd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:02.610887 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e8d0e8b2-3d22-4ed8-b4d9-26dd80eb4abd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:02.611565 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e8d0e8b2-3d22-4ed8-b4d9-26dd80eb4abd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:02.612038 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e8d0e8b2-3d22-4ed8-b4d9-26dd80eb4abd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:02.612459 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e8d0e8b2-3d22-4ed8-b4d9-26dd80eb4abd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:02.775807 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e8d0e8b2-3d22-4ed8-b4d9-26dd80eb4abd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:02.784529 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e8d0e8b2-3d22-4ed8-b4d9-26dd80eb4abd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:02.785956 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e8d0e8b2-3d22-4ed8-b4d9-26dd80eb4abd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:02.787111 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e8d0e8b2-3d22-4ed8-b4d9-26dd80eb4abd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.188302 Aug 30 01:26:02.787662 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 451/895] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:02 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:26:03.809969 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3adf9daf-7e85-4f8c-ac51-248440bb77e9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:03.810723 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3adf9daf-7e85-4f8c-ac51-248440bb77e9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:03.818081 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3adf9daf-7e85-4f8c-ac51-248440bb77e9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:03.818568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3adf9daf-7e85-4f8c-ac51-248440bb77e9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:03.819008 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3adf9daf-7e85-4f8c-ac51-248440bb77e9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:03.819716 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3adf9daf-7e85-4f8c-ac51-248440bb77e9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:03.820206 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3adf9daf-7e85-4f8c-ac51-248440bb77e9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:03.820638 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3adf9daf-7e85-4f8c-ac51-248440bb77e9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:03.957765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3adf9daf-7e85-4f8c-ac51-248440bb77e9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:03.965945 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3adf9daf-7e85-4f8c-ac51-248440bb77e9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:03.967311 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3adf9daf-7e85-4f8c-ac51-248440bb77e9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:03.968515 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3adf9daf-7e85-4f8c-ac51-248440bb77e9 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.162854 Aug 30 01:26:03.969070 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 452/896] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:03 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:26:04.992520 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-dba14938-71e2-42c2-bbd8-c992cf37bda5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:04.993182 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-dba14938-71e2-42c2-bbd8-c992cf37bda5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:04.999875 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dba14938-71e2-42c2-bbd8-c992cf37bda5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:05.000381 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dba14938-71e2-42c2-bbd8-c992cf37bda5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:05.000815 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dba14938-71e2-42c2-bbd8-c992cf37bda5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:05.001513 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dba14938-71e2-42c2-bbd8-c992cf37bda5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:05.002017 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dba14938-71e2-42c2-bbd8-c992cf37bda5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:05.003002 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dba14938-71e2-42c2-bbd8-c992cf37bda5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:05.137269 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-dba14938-71e2-42c2-bbd8-c992cf37bda5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:05.146566 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-dba14938-71e2-42c2-bbd8-c992cf37bda5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:05.148035 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-dba14938-71e2-42c2-bbd8-c992cf37bda5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:05.149261 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-dba14938-71e2-42c2-bbd8-c992cf37bda5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.161752 Aug 30 01:26:05.164554 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 453/897] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:04 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:26:06.179805 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-28f0f209-24c5-4613-9e1b-279866040a82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:06.181331 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-28f0f209-24c5-4613-9e1b-279866040a82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:06.188458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-28f0f209-24c5-4613-9e1b-279866040a82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:06.189270 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-28f0f209-24c5-4613-9e1b-279866040a82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:06.190555 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-28f0f209-24c5-4613-9e1b-279866040a82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:06.191639 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-28f0f209-24c5-4613-9e1b-279866040a82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:06.192359 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-28f0f209-24c5-4613-9e1b-279866040a82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:06.193020 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-28f0f209-24c5-4613-9e1b-279866040a82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:06.345310 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-28f0f209-24c5-4613-9e1b-279866040a82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:06.354290 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-28f0f209-24c5-4613-9e1b-279866040a82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:06.355732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-28f0f209-24c5-4613-9e1b-279866040a82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:06.356919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-28f0f209-24c5-4613-9e1b-279866040a82 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.181333 Aug 30 01:26:06.357467 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 454/898] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:06 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:26:07.381697 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1d9c6206-34f7-40a8-9bf6-b05858c438a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:07.382416 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1d9c6206-34f7-40a8-9bf6-b05858c438a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:07.389448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1d9c6206-34f7-40a8-9bf6-b05858c438a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:07.390037 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1d9c6206-34f7-40a8-9bf6-b05858c438a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:07.390561 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1d9c6206-34f7-40a8-9bf6-b05858c438a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:07.391333 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1d9c6206-34f7-40a8-9bf6-b05858c438a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:07.391863 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1d9c6206-34f7-40a8-9bf6-b05858c438a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:07.392395 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1d9c6206-34f7-40a8-9bf6-b05858c438a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:07.535154 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1d9c6206-34f7-40a8-9bf6-b05858c438a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:07.543547 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1d9c6206-34f7-40a8-9bf6-b05858c438a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:07.545019 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1d9c6206-34f7-40a8-9bf6-b05858c438a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:07.546182 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1d9c6206-34f7-40a8-9bf6-b05858c438a7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.168829 Aug 30 01:26:07.546736 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 455/899] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:07 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:26:08.570436 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4cc38d8c-c772-426c-a367-e1f6f22629a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:08.571114 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4cc38d8c-c772-426c-a367-e1f6f22629a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:08.577695 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4cc38d8c-c772-426c-a367-e1f6f22629a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:08.578188 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4cc38d8c-c772-426c-a367-e1f6f22629a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:08.578645 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4cc38d8c-c772-426c-a367-e1f6f22629a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:08.579334 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4cc38d8c-c772-426c-a367-e1f6f22629a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:08.579781 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4cc38d8c-c772-426c-a367-e1f6f22629a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:08.580234 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4cc38d8c-c772-426c-a367-e1f6f22629a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:08.725194 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4cc38d8c-c772-426c-a367-e1f6f22629a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:08.734116 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4cc38d8c-c772-426c-a367-e1f6f22629a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:08.735733 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4cc38d8c-c772-426c-a367-e1f6f22629a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:08.736966 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4cc38d8c-c772-426c-a367-e1f6f22629a5 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.171123 Aug 30 01:26:08.738656 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 456/900] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:08 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:26:09.760708 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0e727bd3-e80a-4e4a-949e-7bb356544e56 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:09.761372 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0e727bd3-e80a-4e4a-949e-7bb356544e56 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:09.767400 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0e727bd3-e80a-4e4a-949e-7bb356544e56 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:09.767880 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0e727bd3-e80a-4e4a-949e-7bb356544e56 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:09.768350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0e727bd3-e80a-4e4a-949e-7bb356544e56 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:09.769602 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0e727bd3-e80a-4e4a-949e-7bb356544e56 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:09.769998 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0e727bd3-e80a-4e4a-949e-7bb356544e56 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:09.770420 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0e727bd3-e80a-4e4a-949e-7bb356544e56 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:09.930561 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0e727bd3-e80a-4e4a-949e-7bb356544e56 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:09.938751 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0e727bd3-e80a-4e4a-949e-7bb356544e56 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:09.940281 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0e727bd3-e80a-4e4a-949e-7bb356544e56 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:09.941459 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0e727bd3-e80a-4e4a-949e-7bb356544e56 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.184632 Aug 30 01:26:09.942013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 457/901] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:09 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:26:10.964509 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-89c55151-791b-48e2-ba99-40b427362af8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:10.965137 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-89c55151-791b-48e2-ba99-40b427362af8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:10.971411 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89c55151-791b-48e2-ba99-40b427362af8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:10.972097 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89c55151-791b-48e2-ba99-40b427362af8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:10.972529 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89c55151-791b-48e2-ba99-40b427362af8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:10.973208 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89c55151-791b-48e2-ba99-40b427362af8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:10.973650 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89c55151-791b-48e2-ba99-40b427362af8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:10.974067 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89c55151-791b-48e2-ba99-40b427362af8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:11.103537 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-89c55151-791b-48e2-ba99-40b427362af8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:11.111472 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-89c55151-791b-48e2-ba99-40b427362af8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:11.113126 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-89c55151-791b-48e2-ba99-40b427362af8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:11.114275 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-89c55151-791b-48e2-ba99-40b427362af8 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.153929 Aug 30 01:26:11.114832 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 458/902] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:10 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:26:12.029377 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9501d5c3-ed96-4779-a806-ae5861f62e77 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "POST /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.655024 Aug 30 01:26:12.030001 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 445/903] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:26:02 2022] POST /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/os-volume_attachments => generated 194 bytes in 9656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:12.139171 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4c2ad2bb-7b24-4c36-95aa-66b7e8eb8b17 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:12.139782 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4c2ad2bb-7b24-4c36-95aa-66b7e8eb8b17 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:12.148720 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c2ad2bb-7b24-4c36-95aa-66b7e8eb8b17 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:12.150717 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c2ad2bb-7b24-4c36-95aa-66b7e8eb8b17 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:12.150717 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c2ad2bb-7b24-4c36-95aa-66b7e8eb8b17 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:12.150717 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c2ad2bb-7b24-4c36-95aa-66b7e8eb8b17 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:12.150717 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c2ad2bb-7b24-4c36-95aa-66b7e8eb8b17 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:12.151276 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c2ad2bb-7b24-4c36-95aa-66b7e8eb8b17 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:12.300477 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4c2ad2bb-7b24-4c36-95aa-66b7e8eb8b17 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:12.309129 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4c2ad2bb-7b24-4c36-95aa-66b7e8eb8b17 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:12.310572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4c2ad2bb-7b24-4c36-95aa-66b7e8eb8b17 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:12.311884 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4c2ad2bb-7b24-4c36-95aa-66b7e8eb8b17 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.176707 Aug 30 01:26:12.312478 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 459/904] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:12 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:26:13.332720 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=5 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:13.337770 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e2cb0878-1d69-41af-b2c0-bc05696aae7f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:13.338476 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e2cb0878-1d69-41af-b2c0-bc05696aae7f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:13.345149 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2cb0878-1d69-41af-b2c0-bc05696aae7f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:13.345710 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2cb0878-1d69-41af-b2c0-bc05696aae7f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:13.346077 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2cb0878-1d69-41af-b2c0-bc05696aae7f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:13.347410 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2cb0878-1d69-41af-b2c0-bc05696aae7f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:13.347894 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2cb0878-1d69-41af-b2c0-bc05696aae7f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:13.348354 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2cb0878-1d69-41af-b2c0-bc05696aae7f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:13.482733 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e2cb0878-1d69-41af-b2c0-bc05696aae7f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:13.490998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e2cb0878-1d69-41af-b2c0-bc05696aae7f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:13.492461 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e2cb0878-1d69-41af-b2c0-bc05696aae7f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:13.493618 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e2cb0878-1d69-41af-b2c0-bc05696aae7f tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.162655 Aug 30 01:26:13.494164 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 446/905] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:13 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:26:14.516260 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e5f3fe81-e02c-4553-ae4d-cd471cf04256 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:14.516874 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e5f3fe81-e02c-4553-ae4d-cd471cf04256 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:14.524102 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5f3fe81-e02c-4553-ae4d-cd471cf04256 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:14.524594 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5f3fe81-e02c-4553-ae4d-cd471cf04256 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:14.525035 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5f3fe81-e02c-4553-ae4d-cd471cf04256 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:14.525734 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5f3fe81-e02c-4553-ae4d-cd471cf04256 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:14.526194 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5f3fe81-e02c-4553-ae4d-cd471cf04256 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:14.526611 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5f3fe81-e02c-4553-ae4d-cd471cf04256 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:14.656648 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e5f3fe81-e02c-4553-ae4d-cd471cf04256 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:14.674477 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e5f3fe81-e02c-4553-ae4d-cd471cf04256 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:14.676238 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e5f3fe81-e02c-4553-ae4d-cd471cf04256 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:14.679077 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e5f3fe81-e02c-4553-ae4d-cd471cf04256 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.166694 Aug 30 01:26:14.679897 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 460/906] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:14 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:26:15.702775 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-70f077b4-bdf4-417c-a6dc-5edae2123040 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:15.703395 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-70f077b4-bdf4-417c-a6dc-5edae2123040 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:15.712531 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70f077b4-bdf4-417c-a6dc-5edae2123040 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:15.713078 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70f077b4-bdf4-417c-a6dc-5edae2123040 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:15.713508 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70f077b4-bdf4-417c-a6dc-5edae2123040 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:15.714410 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70f077b4-bdf4-417c-a6dc-5edae2123040 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:15.714728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70f077b4-bdf4-417c-a6dc-5edae2123040 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:15.715166 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70f077b4-bdf4-417c-a6dc-5edae2123040 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:15.718009 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:15.851670 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-70f077b4-bdf4-417c-a6dc-5edae2123040 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:15.860259 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-70f077b4-bdf4-417c-a6dc-5edae2123040 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:15.861955 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-70f077b4-bdf4-417c-a6dc-5edae2123040 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:15.863639 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-70f077b4-bdf4-417c-a6dc-5edae2123040 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.164404 Aug 30 01:26:15.864269 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 447/907] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:15 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:26:16.287035 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-3adf90f3-16d1-4565-bfaf-22c2a40d8a08 req-9a5219a5-bce9-4638-a9b4-be0265185233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8722e41f-fb01-458b-b5c7-debe9132c196", "name": "network-vif-plugged", "status": "completed", "tag": "c49d906b-0426-46ea-a3fc-7b2c2024e265"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:16.297504 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-3adf90f3-16d1-4565-bfaf-22c2a40d8a08 req-9a5219a5-bce9-4638-a9b4-be0265185233 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:16.297989 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-3adf90f3-16d1-4565-bfaf-22c2a40d8a08 req-9a5219a5-bce9-4638-a9b4-be0265185233 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:16.298420 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-3adf90f3-16d1-4565-bfaf-22c2a40d8a08 req-9a5219a5-bce9-4638-a9b4-be0265185233 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:16.310751 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-3adf90f3-16d1-4565-bfaf-22c2a40d8a08 req-9a5219a5-bce9-4638-a9b4-be0265185233 service nova] Creating event network-vif-plugged:c49d906b-0426-46ea-a3fc-7b2c2024e265 for instance 8722e41f-fb01-458b-b5c7-debe9132c196 on hv-cinder-81514 Aug 30 01:26:16.315823 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-3adf90f3-16d1-4565-bfaf-22c2a40d8a08 req-9a5219a5-bce9-4638-a9b4-be0265185233 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033592 Aug 30 01:26:16.316814 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 461/908] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:16.886945 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-452b9b83-d333-4cd6-a2a9-37f8955018e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:16.887514 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-452b9b83-d333-4cd6-a2a9-37f8955018e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:16.894004 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-452b9b83-d333-4cd6-a2a9-37f8955018e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:16.895127 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-452b9b83-d333-4cd6-a2a9-37f8955018e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:16.895570 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-452b9b83-d333-4cd6-a2a9-37f8955018e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:16.896297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-452b9b83-d333-4cd6-a2a9-37f8955018e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:16.896752 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-452b9b83-d333-4cd6-a2a9-37f8955018e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:16.897177 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-452b9b83-d333-4cd6-a2a9-37f8955018e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:17.026380 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-452b9b83-d333-4cd6-a2a9-37f8955018e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:17.034414 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-452b9b83-d333-4cd6-a2a9-37f8955018e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:17.036036 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-452b9b83-d333-4cd6-a2a9-37f8955018e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:17.037210 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-452b9b83-d333-4cd6-a2a9-37f8955018e7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.154489 Aug 30 01:26:17.037760 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 448/909] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:16 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:26:18.060809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7f670ff1-53a4-4448-832d-739f9f2a6ac7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:18.061586 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7f670ff1-53a4-4448-832d-739f9f2a6ac7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:18.068773 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7f670ff1-53a4-4448-832d-739f9f2a6ac7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:18.069256 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7f670ff1-53a4-4448-832d-739f9f2a6ac7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:18.069723 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7f670ff1-53a4-4448-832d-739f9f2a6ac7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:18.070646 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7f670ff1-53a4-4448-832d-739f9f2a6ac7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:18.071130 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7f670ff1-53a4-4448-832d-739f9f2a6ac7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:18.071561 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7f670ff1-53a4-4448-832d-739f9f2a6ac7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:18.220090 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7f670ff1-53a4-4448-832d-739f9f2a6ac7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:18.235786 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7f670ff1-53a4-4448-832d-739f9f2a6ac7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:18.237963 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7f670ff1-53a4-4448-832d-739f9f2a6ac7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:18.240011 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7f670ff1-53a4-4448-832d-739f9f2a6ac7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1730 microversion: 2.20 time: 0.184328 Aug 30 01:26:18.248722 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 462/910] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:18 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:26:19.263359 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a7e5ed7f-e9d7-47f2-8a64-1b82de0f72f4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:19.264105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a7e5ed7f-e9d7-47f2-8a64-1b82de0f72f4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:19.271440 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7e5ed7f-e9d7-47f2-8a64-1b82de0f72f4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:19.271925 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7e5ed7f-e9d7-47f2-8a64-1b82de0f72f4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:19.272388 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7e5ed7f-e9d7-47f2-8a64-1b82de0f72f4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:19.273076 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7e5ed7f-e9d7-47f2-8a64-1b82de0f72f4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:19.273524 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7e5ed7f-e9d7-47f2-8a64-1b82de0f72f4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:19.273941 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7e5ed7f-e9d7-47f2-8a64-1b82de0f72f4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:19.407744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a7e5ed7f-e9d7-47f2-8a64-1b82de0f72f4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:19.416476 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a7e5ed7f-e9d7-47f2-8a64-1b82de0f72f4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:19.417906 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a7e5ed7f-e9d7-47f2-8a64-1b82de0f72f4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:19.419094 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a7e5ed7f-e9d7-47f2-8a64-1b82de0f72f4 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1717 microversion: 2.20 time: 0.160231 Aug 30 01:26:19.419665 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 449/911] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:19 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:26:19.633077 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b5772a2c-051f-4345-9b90-771310cf0402 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f257c1f-f45c-4454-87f6-afd886240e76"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:19.635415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b5772a2c-051f-4345-9b90-771310cf0402 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:19.641935 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b5772a2c-051f-4345-9b90-771310cf0402 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:19.642421 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b5772a2c-051f-4345-9b90-771310cf0402 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:19.642863 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b5772a2c-051f-4345-9b90-771310cf0402 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:19.643572 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b5772a2c-051f-4345-9b90-771310cf0402 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:19.644047 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b5772a2c-051f-4345-9b90-771310cf0402 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:19.644568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b5772a2c-051f-4345-9b90-771310cf0402 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:19.726698 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-b5772a2c-051f-4345-9b90-771310cf0402 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Invalid volume: volume 6f257c1f-f45c-4454-87f6-afd886240e76 is already attached to instances: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b5772a2c-051f-4345-9b90-771310cf0402 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: POST /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/os-volume_attachments HTTP/1.1 Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 74 Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:26:19.728690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:26:19.730361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:26:19.730361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:26:19.730361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:26:19.730361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:26:19.730361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:26:19.730361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:26:19.730361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:26:19.730361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:26:19.730361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:26:19.730361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Aug 30 01:26:19.730361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {"volumeAttachment": {"volumeId": "6f257c1f-f45c-4454-87f6-afd886240e76"}} Aug 30 01:26:19.730361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Invalid volume: volume 6f257c1f-f45c-4454-87f6-afd886240e76 is already attached to instances: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'server_id': '0b8c9b12-8dc1-4e3d-988c-12717b48b0b9', 'body': {'volumeAttachment': {'volumeId': '6f257c1f-f45c-4454-87f6-afd886240e76'}}} Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6f257c1f-f45c-4454-87f6-afd886240e76 is already attached to instances: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:19.731422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6f257c1f-f45c-4454-87f6-afd886240e76 is already attached to instances: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:19.732919 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:19.734513 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:19.734513 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:26:19.734513 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:26:19.734513 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6f257c1f-f45c-4454-87f6-afd886240e76 is already attached to instances: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 Aug 30 01:26:19.734513 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:19.734513 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b5772a2c-051f-4345-9b90-771310cf0402 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 400 to user: Invalid volume: volume 6f257c1f-f45c-4454-87f6-afd886240e76 is already attached to instances: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:26:19.734513 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b5772a2c-051f-4345-9b90-771310cf0402 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "POST /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102613 Aug 30 01:26:19.734513 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 463/912] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:26:19 2022] POST /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:26:19.793631 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6e6346ea-0678-4e21-8c33-c6ea38475252 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:19.794119 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6e6346ea-0678-4e21-8c33-c6ea38475252 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:19.800071 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e6346ea-0678-4e21-8c33-c6ea38475252 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:19.800553 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e6346ea-0678-4e21-8c33-c6ea38475252 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:19.800981 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e6346ea-0678-4e21-8c33-c6ea38475252 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:19.801668 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e6346ea-0678-4e21-8c33-c6ea38475252 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:19.802112 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e6346ea-0678-4e21-8c33-c6ea38475252 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:19.802525 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e6346ea-0678-4e21-8c33-c6ea38475252 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:19.884619 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-6e6346ea-0678-4e21-8c33-c6ea38475252 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lazy-loading 'services' on Instance uuid 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:26:19.957537 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6e6346ea-0678-4e21-8c33-c6ea38475252 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/os-volume_attachments/6f257c1f-f45c-4454-87f6-afd886240e76" status: 202 len: 0 microversion: 2.1 time: 0.167576 Aug 30 01:26:19.958138 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 450/913] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Aug 30 01:26:19 2022] DELETE /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/os-volume_attachments/6f257c1f-f45c-4454-87f6-afd886240e76 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:26:19.967132 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a11b1222-be38-444d-9ce1-cd5a2daf7ca9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:19.969296 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a11b1222-be38-444d-9ce1-cd5a2daf7ca9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:19.977369 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a11b1222-be38-444d-9ce1-cd5a2daf7ca9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:19.977854 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a11b1222-be38-444d-9ce1-cd5a2daf7ca9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:19.978280 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a11b1222-be38-444d-9ce1-cd5a2daf7ca9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:19.979229 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a11b1222-be38-444d-9ce1-cd5a2daf7ca9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:19.979675 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a11b1222-be38-444d-9ce1-cd5a2daf7ca9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:19.980116 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a11b1222-be38-444d-9ce1-cd5a2daf7ca9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:20.012800 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a11b1222-be38-444d-9ce1-cd5a2daf7ca9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049458 Aug 30 01:26:20.013373 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 464/914] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:26:19 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:21.026384 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-98a62af6-24e9-4078-a5ba-fc088ae55671 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:21.028675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-98a62af6-24e9-4078-a5ba-fc088ae55671 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:21.034939 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98a62af6-24e9-4078-a5ba-fc088ae55671 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:21.035422 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98a62af6-24e9-4078-a5ba-fc088ae55671 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:21.035861 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98a62af6-24e9-4078-a5ba-fc088ae55671 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:21.036582 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98a62af6-24e9-4078-a5ba-fc088ae55671 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:21.037035 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98a62af6-24e9-4078-a5ba-fc088ae55671 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:21.037462 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98a62af6-24e9-4078-a5ba-fc088ae55671 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:21.068013 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-98a62af6-24e9-4078-a5ba-fc088ae55671 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046605 Aug 30 01:26:21.068604 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 451/915] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:26:21 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:26:21.133863 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-07935918-fad1-4b9c-8d3b-7eb5d1a396c2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:21.134410 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-07935918-fad1-4b9c-8d3b-7eb5d1a396c2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:21.140867 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-07935918-fad1-4b9c-8d3b-7eb5d1a396c2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:21.141352 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-07935918-fad1-4b9c-8d3b-7eb5d1a396c2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:21.141792 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-07935918-fad1-4b9c-8d3b-7eb5d1a396c2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:21.142481 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-07935918-fad1-4b9c-8d3b-7eb5d1a396c2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:21.142935 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-07935918-fad1-4b9c-8d3b-7eb5d1a396c2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:21.143361 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-07935918-fad1-4b9c-8d3b-7eb5d1a396c2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:21.169326 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-07935918-fad1-4b9c-8d3b-7eb5d1a396c2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:26:21.209301 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:21.252401 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-07935918-fad1-4b9c-8d3b-7eb5d1a396c2 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 204 len: 0 microversion: 2.1 time: 0.122596 Aug 30 01:26:21.253055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 465/916] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:26:21 2022] DELETE /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:26:21.261904 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b5d7d1ba-8fbb-433c-8a16-b478a1becf11 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:21.262507 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b5d7d1ba-8fbb-433c-8a16-b478a1becf11 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:21.268343 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5d7d1ba-8fbb-433c-8a16-b478a1becf11 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:21.268822 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5d7d1ba-8fbb-433c-8a16-b478a1becf11 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:21.269250 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5d7d1ba-8fbb-433c-8a16-b478a1becf11 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:21.269927 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5d7d1ba-8fbb-433c-8a16-b478a1becf11 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:21.270372 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5d7d1ba-8fbb-433c-8a16-b478a1becf11 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:21.270792 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5d7d1ba-8fbb-433c-8a16-b478a1becf11 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:21.400313 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b5d7d1ba-8fbb-433c-8a16-b478a1becf11 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:21.408027 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b5d7d1ba-8fbb-433c-8a16-b478a1becf11 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1683 microversion: 2.1 time: 0.150054 Aug 30 01:26:21.408592 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 452/917] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:21 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:22.430544 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9e741fe2-b742-4a3d-96b4-d3819dad85b1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:22.431249 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9e741fe2-b742-4a3d-96b4-d3819dad85b1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:22.433664 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:22.439053 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9e741fe2-b742-4a3d-96b4-d3819dad85b1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:22.439535 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9e741fe2-b742-4a3d-96b4-d3819dad85b1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:22.439974 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9e741fe2-b742-4a3d-96b4-d3819dad85b1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:22.440687 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9e741fe2-b742-4a3d-96b4-d3819dad85b1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:22.441138 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9e741fe2-b742-4a3d-96b4-d3819dad85b1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:22.441563 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9e741fe2-b742-4a3d-96b4-d3819dad85b1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:22.577768 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9e741fe2-b742-4a3d-96b4-d3819dad85b1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:22.586459 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9e741fe2-b742-4a3d-96b4-d3819dad85b1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1683 microversion: 2.1 time: 0.160152 Aug 30 01:26:22.587023 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 466/918] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:22 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:23.607296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-88b76ba3-b25a-4151-be80-f129376e2dd1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:23.607938 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-88b76ba3-b25a-4151-be80-f129376e2dd1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:23.614688 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-88b76ba3-b25a-4151-be80-f129376e2dd1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:23.615169 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-88b76ba3-b25a-4151-be80-f129376e2dd1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:23.615624 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-88b76ba3-b25a-4151-be80-f129376e2dd1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:23.616382 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-88b76ba3-b25a-4151-be80-f129376e2dd1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:23.616974 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-88b76ba3-b25a-4151-be80-f129376e2dd1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:23.617397 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-88b76ba3-b25a-4151-be80-f129376e2dd1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:23.701797 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-88b76ba3-b25a-4151-be80-f129376e2dd1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:23.709535 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-88b76ba3-b25a-4151-be80-f129376e2dd1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 200 len: 1615 microversion: 2.1 time: 0.106438 Aug 30 01:26:23.710106 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 453/919] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:23 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 1615 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:24.073652 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-4b8e7918-03b6-4892-83c0-6e9c757f06fc req-5ec2983a-b3e3-495e-ad77-72c25841b0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b8c9b12-8dc1-4e3d-988c-12717b48b0b9", "name": "network-vif-deleted", "tag": "4fbaf152-1777-4942-b763-c703e397257b"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:24.086028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-4b8e7918-03b6-4892-83c0-6e9c757f06fc req-5ec2983a-b3e3-495e-ad77-72c25841b0df service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:24.086789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-4b8e7918-03b6-4892-83c0-6e9c757f06fc req-5ec2983a-b3e3-495e-ad77-72c25841b0df service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:24.087510 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-4b8e7918-03b6-4892-83c0-6e9c757f06fc req-5ec2983a-b3e3-495e-ad77-72c25841b0df service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:24.100157 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-4b8e7918-03b6-4892-83c0-6e9c757f06fc req-5ec2983a-b3e3-495e-ad77-72c25841b0df service nova] Creating event network-vif-deleted:4fbaf152-1777-4942-b763-c703e397257b for instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 on hv-cinder-81514 Aug 30 01:26:24.107153 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-4b8e7918-03b6-4892-83c0-6e9c757f06fc req-5ec2983a-b3e3-495e-ad77-72c25841b0df service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037542 Aug 30 01:26:24.107763 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 467/920] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:24.732407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f141da57-5448-4afa-bc96-5936ac845d02 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:24.733262 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f141da57-5448-4afa-bc96-5936ac845d02 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:24.740543 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f141da57-5448-4afa-bc96-5936ac845d02 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:24.741191 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f141da57-5448-4afa-bc96-5936ac845d02 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:24.741780 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f141da57-5448-4afa-bc96-5936ac845d02 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:24.743340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f141da57-5448-4afa-bc96-5936ac845d02 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:24.744095 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f141da57-5448-4afa-bc96-5936ac845d02 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:24.744719 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f141da57-5448-4afa-bc96-5936ac845d02 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:24.763693 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-f141da57-5448-4afa-bc96-5936ac845d02 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f141da57-5448-4afa-bc96-5936ac845d02 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 HTTP/1.1 Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:26:24.765563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:26:24.767173 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:26:24.767173 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:26:24.767173 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:26:24.767173 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:26:24.767173 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:26:24.767173 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:26:24.767173 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:26:24.767173 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:26:24.767173 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:26:24.767173 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:26:24.767173 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:26:24.767173 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '0b8c9b12-8dc1-4e3d-988c-12717b48b0b9'} Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:26:24.768176 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:26:24.769498 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:24.771827 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f141da57-5448-4afa-bc96-5936ac845d02 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 404 to user: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:26:24.772830 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f141da57-5448-4afa-bc96-5936ac845d02 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 404 len: 111 microversion: 2.1 time: 0.045248 Aug 30 01:26:24.773480 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 454/921] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:24 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:26:24.783403 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0d1b929c-443c-4c6c-871a-187fd69588c1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '.version_select at 0x7ff48aed61f0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:24.802850 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0d1b929c-443c-4c6c-871a-187fd69588c1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533221894" status: 202 len: 0 microversion: 2.1 time: 0.024306 Aug 30 01:26:24.803763 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 468/922] 10.222.0.44 () {58 vars in 1221 bytes} [Tue Aug 30 01:26:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533221894 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:26:25.417492 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a397c7b2-c09d-4fbb-8789-2f5393972581 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Action: 'create', calling method: .version_select at 0x7ff48ac77c10>, body: {"keypair": {"name": "tempest-keypair-745746834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7DmBLp2phHCAb/zKSCoT3ZHqhRIPmQQ1VnvI48HKE89NxpEm8f/GRkvwQrUNSOEOfmgUMddsvGH+kl9HR9hlobxSo3NMQHdN/1ziF7eFGwNvJdjwdzpCi3ocbJ63iumQ=="}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:25.433610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-a397c7b2-c09d-4fbb-8789-2f5393972581 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for project f5ddbf041c444253aea027770188fbaf. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:26:25.437560 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-a397c7b2-c09d-4fbb-8789-2f5393972581 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for user 4fe36a87392c40379ac160ebaa3cd84c and project f5ddbf041c444253aea027770188fbaf. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:26:25.460101 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a397c7b2-c09d-4fbb-8789-2f5393972581 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047098 Aug 30 01:26:25.460680 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 455/923] 10.222.0.44 () {60 vars in 1159 bytes} [Tue Aug 30 01:26:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:26.712363 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1200473417", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "129a2c61-8cde-4190-8f30-dda20a50e18f"}], "security_groups": [{"name": "tempest-securitygroup--134169586"}], "key_name": "tempest-keypair-745746834", "user_data": "}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:26.818303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] validate_networks() for [('129a2c61-8cde-4190-8f30-dda20a50e18f', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:26:27.312689 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:26:27.313106 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:26:27.313569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:26:27.313973 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:26:27.314376 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:26:27.323647 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:27.324153 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:27.324582 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:27.325301 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:27.325744 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:27.326165 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:27.342811 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for project f5ddbf041c444253aea027770188fbaf. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:26:27.346612 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Getting quotas for user 4fe36a87392c40379ac160ebaa3cd84c and project f5ddbf041c444253aea027770188fbaf. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:26:27.357539 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:26:27.359853 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:26:27.406241 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b4874b1c-2d1f-44b2-bcdf-2ce4bfd85681 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.698887 Aug 30 01:26:27.407267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 469/924] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:26:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:26:27.418370 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ac270848-7dbd-4d26-a8d7-276155860860 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:27.418997 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ac270848-7dbd-4d26-a8d7-276155860860 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:27.475092 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ac270848-7dbd-4d26-a8d7-276155860860 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:27.483288 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ac270848-7dbd-4d26-a8d7-276155860860 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1241 microversion: 2.1 time: 0.069090 Aug 30 01:26:27.483837 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 456/925] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:27 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:28.504753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-297c8c17-d31e-4453-a024-ba19ffa1704d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:28.505394 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-297c8c17-d31e-4453-a024-ba19ffa1704d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:28.512947 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-297c8c17-d31e-4453-a024-ba19ffa1704d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:28.513433 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-297c8c17-d31e-4453-a024-ba19ffa1704d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:28.513874 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-297c8c17-d31e-4453-a024-ba19ffa1704d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:28.514598 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-297c8c17-d31e-4453-a024-ba19ffa1704d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:28.515055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-297c8c17-d31e-4453-a024-ba19ffa1704d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:28.515481 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-297c8c17-d31e-4453-a024-ba19ffa1704d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:28.580796 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-297c8c17-d31e-4453-a024-ba19ffa1704d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:28.589828 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-297c8c17-d31e-4453-a024-ba19ffa1704d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1293 microversion: 2.1 time: 0.089586 Aug 30 01:26:28.590400 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 470/926] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:28 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:29.611556 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2984575e-d17c-493d-ac1e-b6f92cab745d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:29.612251 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2984575e-d17c-493d-ac1e-b6f92cab745d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:29.619484 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2984575e-d17c-493d-ac1e-b6f92cab745d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:29.619985 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2984575e-d17c-493d-ac1e-b6f92cab745d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:29.620443 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2984575e-d17c-493d-ac1e-b6f92cab745d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:29.621162 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2984575e-d17c-493d-ac1e-b6f92cab745d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:29.621621 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2984575e-d17c-493d-ac1e-b6f92cab745d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:29.622052 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2984575e-d17c-493d-ac1e-b6f92cab745d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:29.925033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2984575e-d17c-493d-ac1e-b6f92cab745d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:29.932787 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2984575e-d17c-493d-ac1e-b6f92cab745d tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1366 microversion: 2.1 time: 0.325112 Aug 30 01:26:29.933573 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 457/927] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:29 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:30.182949 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-a6540fae-b777-4fa1-97b3-8ddf83dad3b6 req-9d9cd622-3461-4c09-a85d-46f94e1fe976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b06926c-64dc-4def-b1e8-42f0c956caae", "tag": "3f05a184-fab7-4698-9752-f997cdccbd61"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:30.193474 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a6540fae-b777-4fa1-97b3-8ddf83dad3b6 req-9d9cd622-3461-4c09-a85d-46f94e1fe976 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:30.194568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a6540fae-b777-4fa1-97b3-8ddf83dad3b6 req-9d9cd622-3461-4c09-a85d-46f94e1fe976 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:30.195110 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a6540fae-b777-4fa1-97b3-8ddf83dad3b6 req-9d9cd622-3461-4c09-a85d-46f94e1fe976 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:30.206915 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-a6540fae-b777-4fa1-97b3-8ddf83dad3b6 req-9d9cd622-3461-4c09-a85d-46f94e1fe976 service nova] Creating event network-changed:3f05a184-fab7-4698-9752-f997cdccbd61 for instance 1b06926c-64dc-4def-b1e8-42f0c956caae on hv-cinder-81514 Aug 30 01:26:30.211865 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-a6540fae-b777-4fa1-97b3-8ddf83dad3b6 req-9d9cd622-3461-4c09-a85d-46f94e1fe976 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033553 Aug 30 01:26:30.213152 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 471/928] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:30.953979 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9071b089-a3ae-4ab0-811e-06655ad4091e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:30.954595 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9071b089-a3ae-4ab0-811e-06655ad4091e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:30.961085 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9071b089-a3ae-4ab0-811e-06655ad4091e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:30.961562 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9071b089-a3ae-4ab0-811e-06655ad4091e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:30.961999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9071b089-a3ae-4ab0-811e-06655ad4091e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:30.962693 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9071b089-a3ae-4ab0-811e-06655ad4091e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:30.963192 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9071b089-a3ae-4ab0-811e-06655ad4091e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:30.963566 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9071b089-a3ae-4ab0-811e-06655ad4091e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:31.094804 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9071b089-a3ae-4ab0-811e-06655ad4091e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:31.103380 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9071b089-a3ae-4ab0-811e-06655ad4091e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1366 microversion: 2.1 time: 0.152657 Aug 30 01:26:31.104075 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 458/929] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:30 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:32.126104 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a253a886-ac07-4daf-bfcf-e61125d7e2db tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:32.126945 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a253a886-ac07-4daf-bfcf-e61125d7e2db tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:32.134240 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a253a886-ac07-4daf-bfcf-e61125d7e2db tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:32.134790 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a253a886-ac07-4daf-bfcf-e61125d7e2db tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:32.135434 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a253a886-ac07-4daf-bfcf-e61125d7e2db tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:32.136168 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a253a886-ac07-4daf-bfcf-e61125d7e2db tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:32.136627 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a253a886-ac07-4daf-bfcf-e61125d7e2db tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:32.137055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a253a886-ac07-4daf-bfcf-e61125d7e2db tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:32.269118 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a253a886-ac07-4daf-bfcf-e61125d7e2db tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:32.277500 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a253a886-ac07-4daf-bfcf-e61125d7e2db tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1366 microversion: 2.1 time: 0.155940 Aug 30 01:26:32.278074 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 472/930] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:32 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:33.297690 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-caa2cae6-fa92-4e91-b919-c7ebc79df59a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:33.298303 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-caa2cae6-fa92-4e91-b919-c7ebc79df59a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:33.304846 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-caa2cae6-fa92-4e91-b919-c7ebc79df59a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:33.305322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-caa2cae6-fa92-4e91-b919-c7ebc79df59a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:33.305756 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-caa2cae6-fa92-4e91-b919-c7ebc79df59a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:33.306440 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-caa2cae6-fa92-4e91-b919-c7ebc79df59a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:33.306896 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-caa2cae6-fa92-4e91-b919-c7ebc79df59a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:33.307349 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-caa2cae6-fa92-4e91-b919-c7ebc79df59a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:33.437765 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-caa2cae6-fa92-4e91-b919-c7ebc79df59a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:33.445467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-caa2cae6-fa92-4e91-b919-c7ebc79df59a tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1366 microversion: 2.1 time: 0.151628 Aug 30 01:26:33.446023 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 459/931] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:33 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:34.467062 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5d6a53e9-22dd-4259-9561-a8baaeeebb76 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:34.467672 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5d6a53e9-22dd-4259-9561-a8baaeeebb76 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:34.474468 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d6a53e9-22dd-4259-9561-a8baaeeebb76 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:34.474951 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d6a53e9-22dd-4259-9561-a8baaeeebb76 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:34.475403 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d6a53e9-22dd-4259-9561-a8baaeeebb76 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:34.476118 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d6a53e9-22dd-4259-9561-a8baaeeebb76 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:34.476593 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d6a53e9-22dd-4259-9561-a8baaeeebb76 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:34.477010 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5d6a53e9-22dd-4259-9561-a8baaeeebb76 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:34.609648 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5d6a53e9-22dd-4259-9561-a8baaeeebb76 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:34.617356 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5d6a53e9-22dd-4259-9561-a8baaeeebb76 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1366 microversion: 2.1 time: 0.154695 Aug 30 01:26:34.617929 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 473/932] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:34 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:35.638719 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-421644f2-cdf9-4c18-9670-ea1898f42b1e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:35.639330 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-421644f2-cdf9-4c18-9670-ea1898f42b1e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:35.645894 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-421644f2-cdf9-4c18-9670-ea1898f42b1e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:35.646369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-421644f2-cdf9-4c18-9670-ea1898f42b1e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:35.647073 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-421644f2-cdf9-4c18-9670-ea1898f42b1e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:35.647756 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-421644f2-cdf9-4c18-9670-ea1898f42b1e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:35.648239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-421644f2-cdf9-4c18-9670-ea1898f42b1e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:35.648661 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-421644f2-cdf9-4c18-9670-ea1898f42b1e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:35.788860 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-421644f2-cdf9-4c18-9670-ea1898f42b1e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:35.796705 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-421644f2-cdf9-4c18-9670-ea1898f42b1e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1366 microversion: 2.1 time: 0.162456 Aug 30 01:26:35.797261 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 460/933] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:35 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:36.350910 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-f2e7f548-9cfd-4576-bde7-f44644dfe478 req-5c5798ea-fd16-4b6d-b357-36922df73293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b06926c-64dc-4def-b1e8-42f0c956caae", "name": "network-vif-plugged", "status": "completed", "tag": "3f05a184-fab7-4698-9752-f997cdccbd61"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:36.361408 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-f2e7f548-9cfd-4576-bde7-f44644dfe478 req-5c5798ea-fd16-4b6d-b357-36922df73293 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:36.361981 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-f2e7f548-9cfd-4576-bde7-f44644dfe478 req-5c5798ea-fd16-4b6d-b357-36922df73293 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:36.362419 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-f2e7f548-9cfd-4576-bde7-f44644dfe478 req-5c5798ea-fd16-4b6d-b357-36922df73293 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:36.374124 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-f2e7f548-9cfd-4576-bde7-f44644dfe478 req-5c5798ea-fd16-4b6d-b357-36922df73293 service nova] Creating event network-vif-plugged:3f05a184-fab7-4698-9752-f997cdccbd61 for instance 1b06926c-64dc-4def-b1e8-42f0c956caae on hv-cinder-81514 Aug 30 01:26:36.378998 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-f2e7f548-9cfd-4576-bde7-f44644dfe478 req-5c5798ea-fd16-4b6d-b357-36922df73293 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031832 Aug 30 01:26:36.379790 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 474/934] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:36.817407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2317d2c2-3e73-4f4e-94a6-7544d1cd42ff tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:36.818012 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2317d2c2-3e73-4f4e-94a6-7544d1cd42ff tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:36.825022 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2317d2c2-3e73-4f4e-94a6-7544d1cd42ff tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:36.825493 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2317d2c2-3e73-4f4e-94a6-7544d1cd42ff tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:36.825920 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2317d2c2-3e73-4f4e-94a6-7544d1cd42ff tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:36.826603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2317d2c2-3e73-4f4e-94a6-7544d1cd42ff tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:36.827046 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2317d2c2-3e73-4f4e-94a6-7544d1cd42ff tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:36.827464 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2317d2c2-3e73-4f4e-94a6-7544d1cd42ff tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:36.956478 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2317d2c2-3e73-4f4e-94a6-7544d1cd42ff tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:36.964126 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2317d2c2-3e73-4f4e-94a6-7544d1cd42ff tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1366 microversion: 2.1 time: 0.150537 Aug 30 01:26:36.964828 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 461/935] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:36 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:37.983007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:37.984055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:37.989268 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e6f567f6-4f1f-4771-a214-cffc86c25494 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:37.989971 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e6f567f6-4f1f-4771-a214-cffc86c25494 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:37.998337 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e6f567f6-4f1f-4771-a214-cffc86c25494 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:37.998843 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e6f567f6-4f1f-4771-a214-cffc86c25494 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:37.999260 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e6f567f6-4f1f-4771-a214-cffc86c25494 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:37.999953 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e6f567f6-4f1f-4771-a214-cffc86c25494 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:38.000459 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e6f567f6-4f1f-4771-a214-cffc86c25494 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:38.000882 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e6f567f6-4f1f-4771-a214-cffc86c25494 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:38.139427 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e6f567f6-4f1f-4771-a214-cffc86c25494 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:38.147700 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e6f567f6-4f1f-4771-a214-cffc86c25494 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1366 microversion: 2.1 time: 0.165618 Aug 30 01:26:38.148306 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 475/936] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:37 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:26:39.177915 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ea979a15-eb2a-4e5c-b70a-851d5ebb42b3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:39.178601 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ea979a15-eb2a-4e5c-b70a-851d5ebb42b3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:39.180691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:39.187266 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea979a15-eb2a-4e5c-b70a-851d5ebb42b3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:39.187806 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea979a15-eb2a-4e5c-b70a-851d5ebb42b3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:39.188287 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea979a15-eb2a-4e5c-b70a-851d5ebb42b3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:39.188992 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea979a15-eb2a-4e5c-b70a-851d5ebb42b3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:39.189446 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea979a15-eb2a-4e5c-b70a-851d5ebb42b3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:39.189872 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea979a15-eb2a-4e5c-b70a-851d5ebb42b3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:39.328538 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ea979a15-eb2a-4e5c-b70a-851d5ebb42b3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:39.336194 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ea979a15-eb2a-4e5c-b70a-851d5ebb42b3 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1557 microversion: 2.1 time: 0.162178 Aug 30 01:26:39.336759 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 462/937] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:39 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:39.356865 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-634c0e66-fe17-4c3a-ae36-92e98e834dd9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:39.357356 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-634c0e66-fe17-4c3a-ae36-92e98e834dd9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:39.363462 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-634c0e66-fe17-4c3a-ae36-92e98e834dd9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:39.363932 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-634c0e66-fe17-4c3a-ae36-92e98e834dd9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:39.364393 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-634c0e66-fe17-4c3a-ae36-92e98e834dd9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:39.365078 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-634c0e66-fe17-4c3a-ae36-92e98e834dd9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:39.365519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-634c0e66-fe17-4c3a-ae36-92e98e834dd9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:39.365929 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-634c0e66-fe17-4c3a-ae36-92e98e834dd9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:39.442150 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-634c0e66-fe17-4c3a-ae36-92e98e834dd9 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089788 Aug 30 01:26:39.442740 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 476/938] 10.222.0.44 () {58 vars in 1275 bytes} [Tue Aug 30 01:26:39 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:40.637990 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-3e629069-896f-4054-b997-acd15089ca46 req-8a731124-4160-4ae9-a9f8-191fbd4ee8db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b06926c-64dc-4def-b1e8-42f0c956caae", "tag": "3f05a184-fab7-4698-9752-f997cdccbd61"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:40.647821 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3e629069-896f-4054-b997-acd15089ca46 req-8a731124-4160-4ae9-a9f8-191fbd4ee8db service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:40.648559 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3e629069-896f-4054-b997-acd15089ca46 req-8a731124-4160-4ae9-a9f8-191fbd4ee8db service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:40.648992 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3e629069-896f-4054-b997-acd15089ca46 req-8a731124-4160-4ae9-a9f8-191fbd4ee8db service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:40.660877 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-3e629069-896f-4054-b997-acd15089ca46 req-8a731124-4160-4ae9-a9f8-191fbd4ee8db service nova] Creating event network-changed:3f05a184-fab7-4698-9752-f997cdccbd61 for instance 1b06926c-64dc-4def-b1e8-42f0c956caae on hv-cinder-81514 Aug 30 01:26:40.665969 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-3e629069-896f-4054-b997-acd15089ca46 req-8a731124-4160-4ae9-a9f8-191fbd4ee8db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032353 Aug 30 01:26:40.666626 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 463/939] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:52.772804 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:52.773559 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:52.777677 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-37c1e301-b318-4417-bf4f-0fd29cafe816 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:52.779822 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-37c1e301-b318-4417-bf4f-0fd29cafe816 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:52.787634 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37c1e301-b318-4417-bf4f-0fd29cafe816 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:52.788194 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37c1e301-b318-4417-bf4f-0fd29cafe816 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:52.788685 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37c1e301-b318-4417-bf4f-0fd29cafe816 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:52.789391 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37c1e301-b318-4417-bf4f-0fd29cafe816 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:52.789850 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37c1e301-b318-4417-bf4f-0fd29cafe816 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:52.790272 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37c1e301-b318-4417-bf4f-0fd29cafe816 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:52.824637 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-37c1e301-b318-4417-bf4f-0fd29cafe816 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053363 Aug 30 01:26:52.825448 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 477/940] 10.222.0.44 () {60 vars in 1343 bytes} [Tue Aug 30 01:26:52 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:52.887350 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:52.888138 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:52.893454 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-28908b34-ef94-4390-8744-77aba044fcdd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:52.894052 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-28908b34-ef94-4390-8744-77aba044fcdd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:52.901952 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28908b34-ef94-4390-8744-77aba044fcdd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:52.902418 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28908b34-ef94-4390-8744-77aba044fcdd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:52.902854 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28908b34-ef94-4390-8744-77aba044fcdd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:52.903553 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28908b34-ef94-4390-8744-77aba044fcdd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:52.904015 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28908b34-ef94-4390-8744-77aba044fcdd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:52.904450 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28908b34-ef94-4390-8744-77aba044fcdd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:52.931488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-28908b34-ef94-4390-8744-77aba044fcdd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:26:53.016069 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-28908b34-ef94-4390-8744-77aba044fcdd tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 204 len: 0 microversion: 2.20 time: 0.130118 Aug 30 01:26:53.017463 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 464/941] 10.222.0.44 () {60 vars in 1280 bytes} [Tue Aug 30 01:26:52 2022] DELETE /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 01:26:53.026317 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4ace41cc-6560-443b-8f54-3698044b120b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:53.026927 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4ace41cc-6560-443b-8f54-3698044b120b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:53.033702 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ace41cc-6560-443b-8f54-3698044b120b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:53.034185 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ace41cc-6560-443b-8f54-3698044b120b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:53.034627 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ace41cc-6560-443b-8f54-3698044b120b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:53.035328 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ace41cc-6560-443b-8f54-3698044b120b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:53.035788 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ace41cc-6560-443b-8f54-3698044b120b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:53.036246 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ace41cc-6560-443b-8f54-3698044b120b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:53.176292 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4ace41cc-6560-443b-8f54-3698044b120b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:53.184464 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4ace41cc-6560-443b-8f54-3698044b120b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:53.185901 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4ace41cc-6560-443b-8f54-3698044b120b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:53.187104 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4ace41cc-6560-443b-8f54-3698044b120b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.165295 Aug 30 01:26:53.187706 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 478/942] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:53 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:26:54.212306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6e39a21c-9a31-4819-b87e-ad1df4cc0670 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:54.213020 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6e39a21c-9a31-4819-b87e-ad1df4cc0670 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:54.219550 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e39a21c-9a31-4819-b87e-ad1df4cc0670 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:54.221920 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e39a21c-9a31-4819-b87e-ad1df4cc0670 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:54.222401 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e39a21c-9a31-4819-b87e-ad1df4cc0670 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:54.223114 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e39a21c-9a31-4819-b87e-ad1df4cc0670 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:54.223570 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e39a21c-9a31-4819-b87e-ad1df4cc0670 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:54.224020 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e39a21c-9a31-4819-b87e-ad1df4cc0670 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:54.367840 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6e39a21c-9a31-4819-b87e-ad1df4cc0670 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:54.378389 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6e39a21c-9a31-4819-b87e-ad1df4cc0670 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:54.379846 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6e39a21c-9a31-4819-b87e-ad1df4cc0670 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:54.381086 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6e39a21c-9a31-4819-b87e-ad1df4cc0670 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1723 microversion: 2.20 time: 0.173464 Aug 30 01:26:54.381648 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 465/943] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:54 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:26:55.405664 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d02d8b34-23e4-4d69-8803-36842171cb2e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:55.406269 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d02d8b34-23e4-4d69-8803-36842171cb2e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:55.418350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d02d8b34-23e4-4d69-8803-36842171cb2e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:55.418350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d02d8b34-23e4-4d69-8803-36842171cb2e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:55.418350 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d02d8b34-23e4-4d69-8803-36842171cb2e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:55.419093 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d02d8b34-23e4-4d69-8803-36842171cb2e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:55.419609 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d02d8b34-23e4-4d69-8803-36842171cb2e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:55.420058 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d02d8b34-23e4-4d69-8803-36842171cb2e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:55.490083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d02d8b34-23e4-4d69-8803-36842171cb2e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:55.498325 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d02d8b34-23e4-4d69-8803-36842171cb2e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:55.499717 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d02d8b34-23e4-4d69-8803-36842171cb2e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bf08f4cdb24731bf00c7962bf81c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d08b735ca4249309f4ecd40cbacd537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:55.500895 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d02d8b34-23e4-4d69-8803-36842171cb2e tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 200 len: 1656 microversion: 2.20 time: 0.099549 Aug 30 01:26:55.501522 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 479/944] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:55 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 1656 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:26:55.687262 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-20e44f59-4a8b-4d67-97ea-bcc0eda18b02 req-a8067694-4a6c-4ffb-9d31-90f728b5cc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8722e41f-fb01-458b-b5c7-debe9132c196", "name": "network-vif-deleted", "tag": "c49d906b-0426-46ea-a3fc-7b2c2024e265"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:55.700998 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-20e44f59-4a8b-4d67-97ea-bcc0eda18b02 req-a8067694-4a6c-4ffb-9d31-90f728b5cc95 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:55.701834 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-20e44f59-4a8b-4d67-97ea-bcc0eda18b02 req-a8067694-4a6c-4ffb-9d31-90f728b5cc95 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:55.702360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-20e44f59-4a8b-4d67-97ea-bcc0eda18b02 req-a8067694-4a6c-4ffb-9d31-90f728b5cc95 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:55.715350 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-20e44f59-4a8b-4d67-97ea-bcc0eda18b02 req-a8067694-4a6c-4ffb-9d31-90f728b5cc95 service nova] Creating event network-vif-deleted:c49d906b-0426-46ea-a3fc-7b2c2024e265 for instance 8722e41f-fb01-458b-b5c7-debe9132c196 on hv-cinder-81514 Aug 30 01:26:55.721688 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-20e44f59-4a8b-4d67-97ea-bcc0eda18b02 req-a8067694-4a6c-4ffb-9d31-90f728b5cc95 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037627 Aug 30 01:26:55.722533 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 466/945] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:56.529993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2f17c8ca-80ec-4b1f-9706-b153926cdf35 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:56.530600 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2f17c8ca-80ec-4b1f-9706-b153926cdf35 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:56.538022 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2f17c8ca-80ec-4b1f-9706-b153926cdf35 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:56.538510 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2f17c8ca-80ec-4b1f-9706-b153926cdf35 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:56.538952 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2f17c8ca-80ec-4b1f-9706-b153926cdf35 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:56.539660 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2f17c8ca-80ec-4b1f-9706-b153926cdf35 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:56.540150 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2f17c8ca-80ec-4b1f-9706-b153926cdf35 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:56.540568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2f17c8ca-80ec-4b1f-9706-b153926cdf35 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:56.554898 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-2f17c8ca-80ec-4b1f-9706-b153926cdf35 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] HTTP exception thrown: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2f17c8ca-80ec-4b1f-9706-b153926cdf35 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Request method failure captured: Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 HTTP/1.1 Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWY4Ajr1SHvjTvYB1tIwdBkhWriM__geK0tOaMrq7JCyTkPk0MHO_YmWxf20UItyW7_qwvTmot3mLAHLiHU1_DBPq1CXMeS3-e2q0Cm5f8dUVolW_hQSrMhOnHSkEpJ1Va5tRh6mAHJBHtyzFrp2cUK6_rHHi2j_1rOqbWRK4ag7TFs Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: 5d08b735ca4249309f4ecd40cbacd537 Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:26:56.556809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:26:56.558519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:26:56.558519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:56.558519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 5d08b735ca4249309f4ecd40cbacd537 Aug 30 01:26:56.558519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:56.558519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeShelveTestJSON-4862544-project Aug 30 01:26:56.558519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:26:56.558519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:26:56.558519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 22bf08f4cdb24731bf00c7962bf81c40 Aug 30 01:26:56.558519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeShelveTestJSON-4862544-project Aug 30 01:26:56.558519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:26:56.558519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:56.558519 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '8722e41f-fb01-458b-b5c7-debe9132c196'} Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:26:56.559438 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:56.561013 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:56.562406 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2f17c8ca-80ec-4b1f-9706-b153926cdf35 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Returning 404 to user: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:26:56.562406 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2f17c8ca-80ec-4b1f-9706-b153926cdf35 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 404 len: 111 microversion: 2.20 time: 0.032123 Aug 30 01:26:56.562406 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 480/946] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:56 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:26:56.573063 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d58ccba9-4d5d-40d2-8a6a-b18332ec372b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '.version_select at 0x7ff48adc3f70>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:56.597929 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d58ccba9-4d5d-40d2-8a6a-b18332ec372b tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550608156" status: 204 len: 0 microversion: 2.20 time: 0.029150 Aug 30 01:26:56.598509 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 467/947] 10.222.0.44 () {60 vars in 1262 bytes} [Tue Aug 30 01:26:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550608156 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 01:26:58.370950 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5cd2007d-69b1-48bf-a53b-4deb3c54c572 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:58.371981 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5cd2007d-69b1-48bf-a53b-4deb3c54c572 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:58.378514 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5cd2007d-69b1-48bf-a53b-4deb3c54c572 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:58.379007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5cd2007d-69b1-48bf-a53b-4deb3c54c572 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:58.379444 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5cd2007d-69b1-48bf-a53b-4deb3c54c572 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:58.380193 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5cd2007d-69b1-48bf-a53b-4deb3c54c572 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:58.380645 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5cd2007d-69b1-48bf-a53b-4deb3c54c572 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:58.381072 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5cd2007d-69b1-48bf-a53b-4deb3c54c572 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:58.396239 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-5cd2007d-69b1-48bf-a53b-4deb3c54c572 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] HTTP exception thrown: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5cd2007d-69b1-48bf-a53b-4deb3c54c572 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Request method failure captured: Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 HTTP/1.1 Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWY4Ajr1SHvjTvYB1tIwdBkhWriM__geK0tOaMrq7JCyTkPk0MHO_YmWxf20UItyW7_qwvTmot3mLAHLiHU1_DBPq1CXMeS3-e2q0Cm5f8dUVolW_hQSrMhOnHSkEpJ1Va5tRh6mAHJBHtyzFrp2cUK6_rHHi2j_1rOqbWRK4ag7TFs Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: 5d08b735ca4249309f4ecd40cbacd537 Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:26:58.397801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:26:58.399493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:26:58.399493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:58.399493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 5d08b735ca4249309f4ecd40cbacd537 Aug 30 01:26:58.399493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:58.399493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeShelveTestJSON-4862544-project Aug 30 01:26:58.399493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:26:58.399493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:26:58.399493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 22bf08f4cdb24731bf00c7962bf81c40 Aug 30 01:26:58.399493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeShelveTestJSON-4862544-project Aug 30 01:26:58.399493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:26:58.399493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:58.399493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '8722e41f-fb01-458b-b5c7-debe9132c196'} Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:26:58.400483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:58.401968 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:58.403435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5cd2007d-69b1-48bf-a53b-4deb3c54c572 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Returning 404 to user: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:26:58.403435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5cd2007d-69b1-48bf-a53b-4deb3c54c572 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 404 len: 111 microversion: 2.20 time: 0.032204 Aug 30 01:26:58.403435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 481/948] 10.222.0.44 () {60 vars in 1280 bytes} [Tue Aug 30 01:26:58 2022] DELETE /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:26:58.410048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5ef845f3-60c3-41ce-b908-eb6dff9551c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:58.410788 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5ef845f3-60c3-41ce-b908-eb6dff9551c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 8722e41f-fb01-458b-b5c7-debe9132c196] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:58.417976 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5ef845f3-60c3-41ce-b908-eb6dff9551c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:58.418465 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5ef845f3-60c3-41ce-b908-eb6dff9551c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:58.418907 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5ef845f3-60c3-41ce-b908-eb6dff9551c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:58.419606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5ef845f3-60c3-41ce-b908-eb6dff9551c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:58.420099 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5ef845f3-60c3-41ce-b908-eb6dff9551c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:58.420530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5ef845f3-60c3-41ce-b908-eb6dff9551c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:58.433661 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-5ef845f3-60c3-41ce-b908-eb6dff9551c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] HTTP exception thrown: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5ef845f3-60c3-41ce-b908-eb6dff9551c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Request method failure captured: Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 HTTP/1.1 Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWY4Ajr1SHvjTvYB1tIwdBkhWriM__geK0tOaMrq7JCyTkPk0MHO_YmWxf20UItyW7_qwvTmot3mLAHLiHU1_DBPq1CXMeS3-e2q0Cm5f8dUVolW_hQSrMhOnHSkEpJ1Va5tRh6mAHJBHtyzFrp2cUK6_rHHi2j_1rOqbWRK4ag7TFs Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 5d08b735ca4249309f4ecd40cbacd537 Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:26:58.435306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:26:58.436972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:26:58.436972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:58.436972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 5d08b735ca4249309f4ecd40cbacd537 Aug 30 01:26:58.436972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:58.436972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeShelveTestJSON-4862544-project Aug 30 01:26:58.436972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:26:58.436972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:26:58.436972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 22bf08f4cdb24731bf00c7962bf81c40 Aug 30 01:26:58.436972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeShelveTestJSON-4862544-project Aug 30 01:26:58.436972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:26:58.436972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:58.436972 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '8722e41f-fb01-458b-b5c7-debe9132c196'} Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:26:58.437793 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. Aug 30 01:26:58.438977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:58.440183 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5ef845f3-60c3-41ce-b908-eb6dff9551c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Returning 404 to user: Instance 8722e41f-fb01-458b-b5c7-debe9132c196 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:26:58.440183 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5ef845f3-60c3-41ce-b908-eb6dff9551c6 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196" status: 404 len: 111 microversion: 2.20 time: 0.032128 Aug 30 01:26:58.440183 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 468/949] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:58 2022] GET /compute/v2.1/servers/8722e41f-fb01-458b-b5c7-debe9132c196 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:26:59.577263 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-57c533b2-0ddf-4245-9f86-31f2f791005c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:59.577746 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-57c533b2-0ddf-4245-9f86-31f2f791005c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:59.584179 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57c533b2-0ddf-4245-9f86-31f2f791005c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:59.584664 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57c533b2-0ddf-4245-9f86-31f2f791005c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:59.585105 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57c533b2-0ddf-4245-9f86-31f2f791005c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:59.585795 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57c533b2-0ddf-4245-9f86-31f2f791005c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:59.586252 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57c533b2-0ddf-4245-9f86-31f2f791005c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:59.586680 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57c533b2-0ddf-4245-9f86-31f2f791005c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:59.600562 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-57c533b2-0ddf-4245-9f86-31f2f791005c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] HTTP exception thrown: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-57c533b2-0ddf-4245-9f86-31f2f791005c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Request method failure captured: Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 HTTP/1.1 Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWY4Ajr1SHvjTvYB1tIwdBkhWriM__geK0tOaMrq7JCyTkPk0MHO_YmWxf20UItyW7_qwvTmot3mLAHLiHU1_DBPq1CXMeS3-e2q0Cm5f8dUVolW_hQSrMhOnHSkEpJ1Va5tRh6mAHJBHtyzFrp2cUK6_rHHi2j_1rOqbWRK4ag7TFs Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: 5d08b735ca4249309f4ecd40cbacd537 Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:26:59.602092 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:26:59.603767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:26:59.603767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:59.603767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 5d08b735ca4249309f4ecd40cbacd537 Aug 30 01:26:59.603767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:59.603767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeShelveTestJSON-4862544-project Aug 30 01:26:59.603767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:26:59.603767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:26:59.603767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 22bf08f4cdb24731bf00c7962bf81c40 Aug 30 01:26:59.603767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeShelveTestJSON-4862544-project Aug 30 01:26:59.603767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:26:59.603767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:26:59.603767 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '7fa5b2d0-a841-4330-998e-ecb58b4ef9f3'} Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:26:59.604606 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:26:59.606180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:26:59.607673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-57c533b2-0ddf-4245-9f86-31f2f791005c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Returning 404 to user: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:26:59.607673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-57c533b2-0ddf-4245-9f86-31f2f791005c tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 404 len: 111 microversion: 2.20 time: 0.030170 Aug 30 01:26:59.607673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 482/950] 10.222.0.44 () {60 vars in 1280 bytes} [Tue Aug 30 01:26:59 2022] DELETE /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:26:59.613085 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9404ce2c-6f5b-4896-8a52-d221cca1d4f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:59.613697 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9404ce2c-6f5b-4896-8a52-d221cca1d4f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] [instance: 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:59.620562 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9404ce2c-6f5b-4896-8a52-d221cca1d4f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:59.621038 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9404ce2c-6f5b-4896-8a52-d221cca1d4f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:59.621472 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9404ce2c-6f5b-4896-8a52-d221cca1d4f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:59.622158 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9404ce2c-6f5b-4896-8a52-d221cca1d4f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:59.622610 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9404ce2c-6f5b-4896-8a52-d221cca1d4f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:59.623034 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9404ce2c-6f5b-4896-8a52-d221cca1d4f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:59.636165 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-9404ce2c-6f5b-4896-8a52-d221cca1d4f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] HTTP exception thrown: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9404ce2c-6f5b-4896-8a52-d221cca1d4f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Request method failure captured: Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 HTTP/1.1 Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWY4Ajr1SHvjTvYB1tIwdBkhWriM__geK0tOaMrq7JCyTkPk0MHO_YmWxf20UItyW7_qwvTmot3mLAHLiHU1_DBPq1CXMeS3-e2q0Cm5f8dUVolW_hQSrMhOnHSkEpJ1Va5tRh6mAHJBHtyzFrp2cUK6_rHHi2j_1rOqbWRK4ag7TFs Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 5d08b735ca4249309f4ecd40cbacd537 Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:26:59.637682 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:26:59.639342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5d08b735ca4249309f4ecd40cbacd537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:26:59.639342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:59.639342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 5d08b735ca4249309f4ecd40cbacd537 Aug 30 01:26:59.639342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-4862544 Aug 30 01:26:59.639342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeShelveTestJSON-4862544-project Aug 30 01:26:59.639342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:26:59.639342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:26:59.639342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 22bf08f4cdb24731bf00c7962bf81c40 Aug 30 01:26:59.639342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeShelveTestJSON-4862544-project Aug 30 01:26:59.639342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:26:59.639342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:26:59.639342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '7fa5b2d0-a841-4330-998e-ecb58b4ef9f3'} Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:26:59.640184 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. Aug 30 01:26:59.641623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:26:59.643219 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9404ce2c-6f5b-4896-8a52-d221cca1d4f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] Returning 404 to user: Instance 7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:26:59.643219 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9404ce2c-6f5b-4896-8a52-d221cca1d4f7 tempest-AttachVolumeShelveTestJSON-4862544 tempest-AttachVolumeShelveTestJSON-4862544-project] 10.222.0.44 "GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3" status: 404 len: 111 microversion: 2.20 time: 0.030648 Aug 30 01:26:59.643219 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 469/951] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Aug 30 01:26:59 2022] GET /compute/v2.1/servers/7fa5b2d0-a841-4330-998e-ecb58b4ef9f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:27:00.792197 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2cdbe488-1496-418d-93fd-02b82a36ed3d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:00.793327 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2cdbe488-1496-418d-93fd-02b82a36ed3d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:00.795330 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-a823a5ac-8011-4f7a-b699-85f16c669ca6 req-f05466d6-7d6e-43e3-a412-93668eaf5c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de457d90-8262-4854-a4d9-7ed485c8e630", "tag": "83b9c452-82e4-4050-a7d3-fbb86ea64e52"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:27:00.802632 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2cdbe488-1496-418d-93fd-02b82a36ed3d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:00.807673 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a823a5ac-8011-4f7a-b699-85f16c669ca6 req-f05466d6-7d6e-43e3-a412-93668eaf5c38 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:00.808198 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a823a5ac-8011-4f7a-b699-85f16c669ca6 req-f05466d6-7d6e-43e3-a412-93668eaf5c38 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:00.808635 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a823a5ac-8011-4f7a-b699-85f16c669ca6 req-f05466d6-7d6e-43e3-a412-93668eaf5c38 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:00.808976 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2cdbe488-1496-418d-93fd-02b82a36ed3d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:00.809582 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2cdbe488-1496-418d-93fd-02b82a36ed3d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:00.810484 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2cdbe488-1496-418d-93fd-02b82a36ed3d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:00.811094 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2cdbe488-1496-418d-93fd-02b82a36ed3d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:00.811670 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2cdbe488-1496-418d-93fd-02b82a36ed3d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:00.822276 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-a823a5ac-8011-4f7a-b699-85f16c669ca6 req-f05466d6-7d6e-43e3-a412-93668eaf5c38 service nova] Creating event network-changed:83b9c452-82e4-4050-a7d3-fbb86ea64e52 for instance de457d90-8262-4854-a4d9-7ed485c8e630 on hv-cinder-81514 Aug 30 01:27:00.827597 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-a823a5ac-8011-4f7a-b699-85f16c669ca6 req-f05466d6-7d6e-43e3-a412-93668eaf5c38 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036016 Aug 30 01:27:00.832062 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 470/952] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:27:00.846104 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2cdbe488-1496-418d-93fd-02b82a36ed3d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:27:00.972393 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2cdbe488-1496-418d-93fd-02b82a36ed3d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 204 len: 0 microversion: 2.1 time: 0.183218 Aug 30 01:27:00.978075 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 483/953] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:27:00 2022] DELETE /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:27:00.982699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-26c1bd0c-93cd-49e1-8a16-13dd577c5be8 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:00.983887 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-26c1bd0c-93cd-49e1-8a16-13dd577c5be8 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:00.991860 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-26c1bd0c-93cd-49e1-8a16-13dd577c5be8 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:00.992647 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-26c1bd0c-93cd-49e1-8a16-13dd577c5be8 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:00.993537 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-26c1bd0c-93cd-49e1-8a16-13dd577c5be8 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:00.994451 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-26c1bd0c-93cd-49e1-8a16-13dd577c5be8 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:00.994909 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-26c1bd0c-93cd-49e1-8a16-13dd577c5be8 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:00.995607 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-26c1bd0c-93cd-49e1-8a16-13dd577c5be8 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:01.165888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-26c1bd0c-93cd-49e1-8a16-13dd577c5be8 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:27:01.173983 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-26c1bd0c-93cd-49e1-8a16-13dd577c5be8 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1578 microversion: 2.1 time: 0.195605 Aug 30 01:27:01.188194 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 471/954] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:00 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1578 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:27:02.198034 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-19f96e06-35ac-4df8-8ec9-a3f4d3af319b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:02.199645 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-19f96e06-35ac-4df8-8ec9-a3f4d3af319b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:02.208266 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-19f96e06-35ac-4df8-8ec9-a3f4d3af319b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:02.209351 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-19f96e06-35ac-4df8-8ec9-a3f4d3af319b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:02.209944 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-19f96e06-35ac-4df8-8ec9-a3f4d3af319b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:02.210916 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-19f96e06-35ac-4df8-8ec9-a3f4d3af319b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:02.211369 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-19f96e06-35ac-4df8-8ec9-a3f4d3af319b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:02.211954 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-19f96e06-35ac-4df8-8ec9-a3f4d3af319b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:02.399271 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-19f96e06-35ac-4df8-8ec9-a3f4d3af319b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:27:02.407254 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-19f96e06-35ac-4df8-8ec9-a3f4d3af319b tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1578 microversion: 2.1 time: 0.213575 Aug 30 01:27:02.407835 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 484/955] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:02 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1578 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:27:03.352688 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-60b98960-b3f0-4447-b803-d9f4ffe8093d req-1c27ac34-f92e-443d-b01b-9fe99bdb85e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de457d90-8262-4854-a4d9-7ed485c8e630", "name": "network-vif-deleted", "tag": "83b9c452-82e4-4050-a7d3-fbb86ea64e52"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:27:03.369739 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-60b98960-b3f0-4447-b803-d9f4ffe8093d req-1c27ac34-f92e-443d-b01b-9fe99bdb85e7 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:03.370223 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-60b98960-b3f0-4447-b803-d9f4ffe8093d req-1c27ac34-f92e-443d-b01b-9fe99bdb85e7 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:03.370776 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-60b98960-b3f0-4447-b803-d9f4ffe8093d req-1c27ac34-f92e-443d-b01b-9fe99bdb85e7 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:03.402411 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-60b98960-b3f0-4447-b803-d9f4ffe8093d req-1c27ac34-f92e-443d-b01b-9fe99bdb85e7 service nova] Creating event network-vif-deleted:83b9c452-82e4-4050-a7d3-fbb86ea64e52 for instance de457d90-8262-4854-a4d9-7ed485c8e630 on hv-cinder-81514 Aug 30 01:27:03.407832 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-60b98960-b3f0-4447-b803-d9f4ffe8093d req-1c27ac34-f92e-443d-b01b-9fe99bdb85e7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058661 Aug 30 01:27:03.408577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 472/956] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:27:03.435845 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b40ac991-77d7-4de1-89e5-ee498137a72d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:03.437007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b40ac991-77d7-4de1-89e5-ee498137a72d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:03.445349 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b40ac991-77d7-4de1-89e5-ee498137a72d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:03.446028 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b40ac991-77d7-4de1-89e5-ee498137a72d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:03.446623 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b40ac991-77d7-4de1-89e5-ee498137a72d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:03.447699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b40ac991-77d7-4de1-89e5-ee498137a72d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:03.448744 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b40ac991-77d7-4de1-89e5-ee498137a72d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:03.449320 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b40ac991-77d7-4de1-89e5-ee498137a72d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:03.541418 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b40ac991-77d7-4de1-89e5-ee498137a72d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:27:03.551690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b40ac991-77d7-4de1-89e5-ee498137a72d tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 200 len: 1224 microversion: 2.1 time: 0.124534 Aug 30 01:27:03.551690 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 485/957] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:03 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 1224 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:27:04.571372 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bf82742c-5952-4ed8-9fbe-7417e20ee41c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:04.572173 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bf82742c-5952-4ed8-9fbe-7417e20ee41c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: de457d90-8262-4854-a4d9-7ed485c8e630] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:04.578703 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bf82742c-5952-4ed8-9fbe-7417e20ee41c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:04.579179 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bf82742c-5952-4ed8-9fbe-7417e20ee41c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:04.579604 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bf82742c-5952-4ed8-9fbe-7417e20ee41c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:04.580311 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bf82742c-5952-4ed8-9fbe-7417e20ee41c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:04.580761 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bf82742c-5952-4ed8-9fbe-7417e20ee41c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:04.581174 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bf82742c-5952-4ed8-9fbe-7417e20ee41c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:04.594570 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-bf82742c-5952-4ed8-9fbe-7417e20ee41c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] HTTP exception thrown: Instance de457d90-8262-4854-a4d9-7ed485c8e630 could not be found. Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bf82742c-5952-4ed8-9fbe-7417e20ee41c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Request method failure captured: Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 HTTP/1.1 Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWWKG106_ye37k3Cc3N6VL7xjNtxZC6Z2Z1FBU4Q0VcVjnxhkf25XlB1qpGxx0dW38JLa-zrMhuoKgNq4y_H5VfBWkxmEn3b7hjbG5R-opms2i_s3X3OFnGoFIiChMZyEFAmYDMZOh8oyMKLRge1H0JCNzLR8Vvj3j-tdqRjPpTZ-Vs Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: 20cdcff29a0448dc92460b2ddd45617b Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:27:04.596235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:27:04.597603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:04.597603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:27:04.597603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 20cdcff29a0448dc92460b2ddd45617b Aug 30 01:27:04.597603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:27:04.597603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-TestVolumeBootPattern-1380496173-project Aug 30 01:27:04.597603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:27:04.597603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:27:04.597603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 2839103f52324a1ab1ebd43fe230addc Aug 30 01:27:04.597603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-TestVolumeBootPattern-1380496173-project Aug 30 01:27:04.597603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:27:04.597603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance de457d90-8262-4854-a4d9-7ed485c8e630 could not be found. Aug 30 01:27:04.597603 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': 'de457d90-8262-4854-a4d9-7ed485c8e630'} Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de457d90-8262-4854-a4d9-7ed485c8e630 could not be found. Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:04.598585 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de457d90-8262-4854-a4d9-7ed485c8e630 could not be found. Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de457d90-8262-4854-a4d9-7ed485c8e630 could not be found. Aug 30 01:27:04.600180 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:04.601880 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bf82742c-5952-4ed8-9fbe-7417e20ee41c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Returning 404 to user: Instance de457d90-8262-4854-a4d9-7ed485c8e630 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:04.601880 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bf82742c-5952-4ed8-9fbe-7417e20ee41c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630" status: 404 len: 111 microversion: 2.1 time: 0.030242 Aug 30 01:27:04.601880 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 486/958] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:04 2022] GET /compute/v2.1/servers/de457d90-8262-4854-a4d9-7ed485c8e630 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:27:04.662225 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b05c92fe-b173-48f9-8aa7-51313d6b92ec tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] Action: 'create', calling method: .version_select at 0x7ff48af299d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1727888564", "metadata": {"Type": "work"}}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:27:04.969407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b05c92fe-b173-48f9-8aa7-51313d6b92ec tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.434136 Aug 30 01:27:04.970023 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 473/959] 10.222.0.44 () {60 vars in 1156 bytes} [Tue Aug 30 01:27:04 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 436 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 01:27:04.987259 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3a9e15d8-b2c1-4dde-8af6-d7b5c77c4776 tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] Calling method '.version_select at 0x7ff48acbd8b0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:05.046708 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3a9e15d8-b2c1-4dde-8af6-d7b5c77c4776 tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b0937113-ca0f-41b8-8262-75bc5d8f698b" status: 200 len: 353 microversion: 2.1 time: 0.064709 Aug 30 01:27:05.047277 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 487/960] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Aug 30 01:27:04 2022] GET /compute/v2.1/os-volumes/b0937113-ca0f-41b8-8262-75bc5d8f698b => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:27:06.061680 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7a70920f-0ab0-44d6-8a85-fd798e4b6227 tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] Calling method '.version_select at 0x7ff48aee60d0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:06.110987 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7a70920f-0ab0-44d6-8a85-fd798e4b6227 tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b0937113-ca0f-41b8-8262-75bc5d8f698b" status: 200 len: 354 microversion: 2.1 time: 0.053619 Aug 30 01:27:06.111694 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 474/961] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Aug 30 01:27:06 2022] GET /compute/v2.1/os-volumes/b0937113-ca0f-41b8-8262-75bc5d8f698b => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:27:06.125131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2209b286-6f91-46e2-9972-7fdf096edcd3 tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] Calling method '.version_select at 0x7ff48aeec4c0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:06.172094 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2209b286-6f91-46e2-9972-7fdf096edcd3 tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b0937113-ca0f-41b8-8262-75bc5d8f698b" status: 200 len: 354 microversion: 2.1 time: 0.051166 Aug 30 01:27:06.172858 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 488/962] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Aug 30 01:27:06 2022] GET /compute/v2.1/os-volumes/b0937113-ca0f-41b8-8262-75bc5d8f698b => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:27:06.191270 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-222fa3e4-79ed-4f6f-a6ea-f1ae14d6b7b9 tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] Calling method '.version_select at 0x7ff48af29ee0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:06.261236 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-222fa3e4-79ed-4f6f-a6ea-f1ae14d6b7b9 tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/b0937113-ca0f-41b8-8262-75bc5d8f698b" status: 202 len: 0 microversion: 2.1 time: 0.073856 Aug 30 01:27:06.261796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 475/963] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Aug 30 01:27:06 2022] DELETE /compute/v2.1/os-volumes/b0937113-ca0f-41b8-8262-75bc5d8f698b => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:27:06.269761 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1585a79b-9725-4f3b-9551-fc2b89e9249c tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] Calling method '.version_select at 0x7ff48aebab80>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:06.318640 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1585a79b-9725-4f3b-9551-fc2b89e9249c tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b0937113-ca0f-41b8-8262-75bc5d8f698b" status: 200 len: 353 microversion: 2.1 time: 0.052655 Aug 30 01:27:06.319208 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 489/964] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Aug 30 01:27:06 2022] GET /compute/v2.1/os-volumes/b0937113-ca0f-41b8-8262-75bc5d8f698b => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:27:07.334378 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-549d70e6-95f8-45be-b172-91ecae8b7582 tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] Calling method '.version_select at 0x7ff48ad0b670>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:07.365038 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-549d70e6-95f8-45be-b172-91ecae8b7582 tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] HTTP exception thrown: Volume b0937113-ca0f-41b8-8262-75bc5d8f698b could not be found. Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-549d70e6-95f8-45be-b172-91ecae8b7582 tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] Request method failure captured: Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/os-volumes/b0937113-ca0f-41b8-8262-75bc5d8f698b HTTP/1.1 Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWdo2VGP5jZiYTTDNZJFJQgtkpalke_-DBEHKs8X39fWzxNpr6QQeERs96fXQluWNm9H5NRguDaBoEUIl97o6ZigYv-YwHq4JJZ5sBtJDrpT97twtpIQRK5ghjXMURGw6t8Udg-UJT5LBdqKJIuoVqbvlqHCJByWvpBvNI_So6XqNlM Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 2327fae7aef3473c8ff5d88a7c0c6ab9 Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesGetTestJSON-334625567 Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:27:07.367340 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:27:07.368919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2327fae7aef3473c8ff5d88a7c0c6ab9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2327fae7aef3473c8ff5d88a7c0c6ab9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2327fae7aef3473c8ff5d88a7c0c6ab9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2327fae7aef3473c8ff5d88a7c0c6ab9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:07.368919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesGetTestJSON-334625567 Aug 30 01:27:07.368919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 2327fae7aef3473c8ff5d88a7c0c6ab9 Aug 30 01:27:07.368919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesGetTestJSON-334625567 Aug 30 01:27:07.368919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesGetTestJSON-334625567-project Aug 30 01:27:07.368919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:27:07.368919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:27:07.368919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 533dbf811cbf4c8eaea5213bf135a071 Aug 30 01:27:07.368919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesGetTestJSON-334625567-project Aug 30 01:27:07.368919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: Aug 30 01:27:07.368919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Volume b0937113-ca0f-41b8-8262-75bc5d8f698b could not be found. Aug 30 01:27:07.368919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': 'b0937113-ca0f-41b8-8262-75bc5d8f698b'} Aug 30 01:27:07.368919 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0937113-ca0f-41b8-8262-75bc5d8f698b could not be found. (HTTP 404) (Request-ID: req-9b1b7355-41bd-4c7f-8bac-44ed6c92bfb7) Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:07.369866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:27:07.371452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0937113-ca0f-41b8-8262-75bc5d8f698b could not be found. Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:27:07.373296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0937113-ca0f-41b8-8262-75bc5d8f698b could not be found. Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0937113-ca0f-41b8-8262-75bc5d8f698b could not be found. Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-549d70e6-95f8-45be-b172-91ecae8b7582 tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] Returning 404 to user: Volume b0937113-ca0f-41b8-8262-75bc5d8f698b could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-549d70e6-95f8-45be-b172-91ecae8b7582 tempest-VolumesGetTestJSON-334625567 tempest-VolumesGetTestJSON-334625567-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b0937113-ca0f-41b8-8262-75bc5d8f698b" status: 404 len: 109 microversion: 2.1 time: 0.039699 Aug 30 01:27:07.374699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 476/965] 10.222.0.44 () {58 vars in 1245 bytes} [Tue Aug 30 01:27:07 2022] GET /compute/v2.1/os-volumes/b0937113-ca0f-41b8-8262-75bc5d8f698b => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:27:07.797302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e527137a-12a8-4406-9ba2-6ac85ba73eeb tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:07.798397 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e527137a-12a8-4406-9ba2-6ac85ba73eeb tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:07.805786 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e527137a-12a8-4406-9ba2-6ac85ba73eeb tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:07.806743 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-61339e51-fe3f-42ed-8241-33ab5fa75fa4 req-b3ad662d-217f-40f9-b039-988e02b77df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0114fa80-59aa-458a-a4c3-6f49bdfa56bd", "tag": "a1ad209b-8fbb-43fc-9b1e-2133ae985606"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:27:07.807211 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e527137a-12a8-4406-9ba2-6ac85ba73eeb tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:07.807986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e527137a-12a8-4406-9ba2-6ac85ba73eeb tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:07.808891 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e527137a-12a8-4406-9ba2-6ac85ba73eeb tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:07.809498 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e527137a-12a8-4406-9ba2-6ac85ba73eeb tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:07.810148 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e527137a-12a8-4406-9ba2-6ac85ba73eeb tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:07.830723 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-61339e51-fe3f-42ed-8241-33ab5fa75fa4 req-b3ad662d-217f-40f9-b039-988e02b77df4 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:07.831463 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-61339e51-fe3f-42ed-8241-33ab5fa75fa4 req-b3ad662d-217f-40f9-b039-988e02b77df4 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:07.832178 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-61339e51-fe3f-42ed-8241-33ab5fa75fa4 req-b3ad662d-217f-40f9-b039-988e02b77df4 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:07.844779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-61339e51-fe3f-42ed-8241-33ab5fa75fa4 req-b3ad662d-217f-40f9-b039-988e02b77df4 service nova] Creating event network-changed:a1ad209b-8fbb-43fc-9b1e-2133ae985606 for instance 0114fa80-59aa-458a-a4c3-6f49bdfa56bd on hv-cinder-81514 Aug 30 01:27:07.852075 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e527137a-12a8-4406-9ba2-6ac85ba73eeb tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:27:07.853936 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-61339e51-fe3f-42ed-8241-33ab5fa75fa4 req-b3ad662d-217f-40f9-b039-988e02b77df4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053982 Aug 30 01:27:07.854742 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 477/966] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:27:07.969556 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e527137a-12a8-4406-9ba2-6ac85ba73eeb tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 204 len: 0 microversion: 2.1 time: 0.175304 Aug 30 01:27:07.974155 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 490/967] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:27:07 2022] DELETE /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:27:07.980733 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-af904292-62fb-4240-9102-dd8efecc0a1c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:07.981455 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-af904292-62fb-4240-9102-dd8efecc0a1c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:07.987690 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af904292-62fb-4240-9102-dd8efecc0a1c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:07.988205 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af904292-62fb-4240-9102-dd8efecc0a1c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:07.988636 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af904292-62fb-4240-9102-dd8efecc0a1c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:07.989920 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af904292-62fb-4240-9102-dd8efecc0a1c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:07.990488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af904292-62fb-4240-9102-dd8efecc0a1c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:07.990915 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af904292-62fb-4240-9102-dd8efecc0a1c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:08.219542 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-af904292-62fb-4240-9102-dd8efecc0a1c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:27:08.229426 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-af904292-62fb-4240-9102-dd8efecc0a1c tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1578 microversion: 2.1 time: 0.253393 Aug 30 01:27:08.230029 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 478/968] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:07 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1578 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:27:09.251768 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0c748704-563f-480c-9479-2a0ae8da0dc6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:09.252627 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0c748704-563f-480c-9479-2a0ae8da0dc6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:09.260589 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0c748704-563f-480c-9479-2a0ae8da0dc6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:09.261344 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0c748704-563f-480c-9479-2a0ae8da0dc6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:09.261824 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0c748704-563f-480c-9479-2a0ae8da0dc6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:09.262765 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0c748704-563f-480c-9479-2a0ae8da0dc6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:09.263230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0c748704-563f-480c-9479-2a0ae8da0dc6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:09.263653 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0c748704-563f-480c-9479-2a0ae8da0dc6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:09.446183 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0c748704-563f-480c-9479-2a0ae8da0dc6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:27:09.454261 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0c748704-563f-480c-9479-2a0ae8da0dc6 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1578 microversion: 2.1 time: 0.207142 Aug 30 01:27:09.455003 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 491/969] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:09 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1578 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:27:10.424492 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-879ec423-8493-4a95-b08b-d5af9799de6c req-43c71909-dc1b-4409-a1d1-960fa44db47f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0114fa80-59aa-458a-a4c3-6f49bdfa56bd", "name": "network-vif-deleted", "tag": "a1ad209b-8fbb-43fc-9b1e-2133ae985606"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:27:10.435322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-879ec423-8493-4a95-b08b-d5af9799de6c req-43c71909-dc1b-4409-a1d1-960fa44db47f service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:10.435824 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-879ec423-8493-4a95-b08b-d5af9799de6c req-43c71909-dc1b-4409-a1d1-960fa44db47f service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:10.436274 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-879ec423-8493-4a95-b08b-d5af9799de6c req-43c71909-dc1b-4409-a1d1-960fa44db47f service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:10.447802 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-879ec423-8493-4a95-b08b-d5af9799de6c req-43c71909-dc1b-4409-a1d1-960fa44db47f service nova] Creating event network-vif-deleted:a1ad209b-8fbb-43fc-9b1e-2133ae985606 for instance 0114fa80-59aa-458a-a4c3-6f49bdfa56bd on hv-cinder-81514 Aug 30 01:27:10.452865 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-879ec423-8493-4a95-b08b-d5af9799de6c req-43c71909-dc1b-4409-a1d1-960fa44db47f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153603 Aug 30 01:27:10.453452 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 479/970] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:27:10.475790 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ee5c740f-8b16-404b-a0e5-7270cd165c20 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:10.476426 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ee5c740f-8b16-404b-a0e5-7270cd165c20 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:10.482909 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ee5c740f-8b16-404b-a0e5-7270cd165c20 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:10.483337 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ee5c740f-8b16-404b-a0e5-7270cd165c20 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:10.483770 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ee5c740f-8b16-404b-a0e5-7270cd165c20 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:10.484483 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ee5c740f-8b16-404b-a0e5-7270cd165c20 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:10.484937 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ee5c740f-8b16-404b-a0e5-7270cd165c20 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:10.485377 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ee5c740f-8b16-404b-a0e5-7270cd165c20 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:10.550141 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ee5c740f-8b16-404b-a0e5-7270cd165c20 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2839103f52324a1ab1ebd43fe230addc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20cdcff29a0448dc92460b2ddd45617b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:27:10.558537 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ee5c740f-8b16-404b-a0e5-7270cd165c20 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 200 len: 1224 microversion: 2.1 time: 0.086602 Aug 30 01:27:10.559108 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 492/971] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:10 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:27:11.580783 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3ca4412c-382f-4b21-88cd-1883491be73f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:11.581422 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3ca4412c-382f-4b21-88cd-1883491be73f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 0114fa80-59aa-458a-a4c3-6f49bdfa56bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:11.588694 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ca4412c-382f-4b21-88cd-1883491be73f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:11.589169 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ca4412c-382f-4b21-88cd-1883491be73f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:11.589594 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ca4412c-382f-4b21-88cd-1883491be73f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:11.590280 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ca4412c-382f-4b21-88cd-1883491be73f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:11.590726 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ca4412c-382f-4b21-88cd-1883491be73f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:11.591149 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ca4412c-382f-4b21-88cd-1883491be73f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:11.604584 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-3ca4412c-382f-4b21-88cd-1883491be73f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] HTTP exception thrown: Instance 0114fa80-59aa-458a-a4c3-6f49bdfa56bd could not be found. Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3ca4412c-382f-4b21-88cd-1883491be73f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Request method failure captured: Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd HTTP/1.1 Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWWKG106_ye37k3Cc3N6VL7xjNtxZC6Z2Z1FBU4Q0VcVjnxhkf25XlB1qpGxx0dW38JLa-zrMhuoKgNq4y_H5VfBWkxmEn3b7hjbG5R-opms2i_s3X3OFnGoFIiChMZyEFAmYDMZOh8oyMKLRge1H0JCNzLR8Vvj3j-tdqRjPpTZ-Vs Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 20cdcff29a0448dc92460b2ddd45617b Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:27:11.606199 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:27:11.607859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:11.607859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:27:11.607859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 20cdcff29a0448dc92460b2ddd45617b Aug 30 01:27:11.607859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:27:11.607859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-TestVolumeBootPattern-1380496173-project Aug 30 01:27:11.607859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:27:11.607859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:27:11.607859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 2839103f52324a1ab1ebd43fe230addc Aug 30 01:27:11.607859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-TestVolumeBootPattern-1380496173-project Aug 30 01:27:11.607859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:27:11.607859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 0114fa80-59aa-458a-a4c3-6f49bdfa56bd could not be found. Aug 30 01:27:11.607859 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '0114fa80-59aa-458a-a4c3-6f49bdfa56bd'} Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0114fa80-59aa-458a-a4c3-6f49bdfa56bd could not be found. Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:11.608888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0114fa80-59aa-458a-a4c3-6f49bdfa56bd could not be found. Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0114fa80-59aa-458a-a4c3-6f49bdfa56bd could not be found. Aug 30 01:27:11.610427 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:11.611819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3ca4412c-382f-4b21-88cd-1883491be73f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Returning 404 to user: Instance 0114fa80-59aa-458a-a4c3-6f49bdfa56bd could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:11.611819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3ca4412c-382f-4b21-88cd-1883491be73f tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd" status: 404 len: 111 microversion: 2.1 time: 0.031154 Aug 30 01:27:11.611819 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 480/972] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:11 2022] GET /compute/v2.1/servers/0114fa80-59aa-458a-a4c3-6f49bdfa56bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:27:12.065484 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b95246c4-66b0-4e7b-9d76-6e7cec944763 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:12.066113 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b95246c4-66b0-4e7b-9d76-6e7cec944763 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:12.073303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b95246c4-66b0-4e7b-9d76-6e7cec944763 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:12.073797 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b95246c4-66b0-4e7b-9d76-6e7cec944763 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:12.074211 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b95246c4-66b0-4e7b-9d76-6e7cec944763 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:12.074893 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b95246c4-66b0-4e7b-9d76-6e7cec944763 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:12.075343 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b95246c4-66b0-4e7b-9d76-6e7cec944763 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:12.075764 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b95246c4-66b0-4e7b-9d76-6e7cec944763 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:12.089234 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-b95246c4-66b0-4e7b-9d76-6e7cec944763 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] HTTP exception thrown: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b95246c4-66b0-4e7b-9d76-6e7cec944763 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Request method failure captured: Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d HTTP/1.1 Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWWKG106_ye37k3Cc3N6VL7xjNtxZC6Z2Z1FBU4Q0VcVjnxhkf25XlB1qpGxx0dW38JLa-zrMhuoKgNq4y_H5VfBWkxmEn3b7hjbG5R-opms2i_s3X3OFnGoFIiChMZyEFAmYDMZOh8oyMKLRge1H0JCNzLR8Vvj3j-tdqRjPpTZ-Vs Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: 20cdcff29a0448dc92460b2ddd45617b Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:27:12.090892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:27:12.092569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:12.092569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:27:12.092569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 20cdcff29a0448dc92460b2ddd45617b Aug 30 01:27:12.092569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:27:12.092569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-TestVolumeBootPattern-1380496173-project Aug 30 01:27:12.092569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:27:12.092569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:27:12.092569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 2839103f52324a1ab1ebd43fe230addc Aug 30 01:27:12.092569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-TestVolumeBootPattern-1380496173-project Aug 30 01:27:12.092569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:27:12.092569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:27:12.092569 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '806ac720-5f83-41ac-8053-3debfda5295d'} Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:12.093458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:27:12.095007 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:12.096760 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b95246c4-66b0-4e7b-9d76-6e7cec944763 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Returning 404 to user: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:12.096760 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b95246c4-66b0-4e7b-9d76-6e7cec944763 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "DELETE /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 404 len: 111 microversion: 2.1 time: 0.030655 Aug 30 01:27:12.096760 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 493/973] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:27:12 2022] DELETE /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:27:12.101495 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8c2161e1-2cd1-466a-aaf5-5b5d3ffc7483 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:12.102115 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8c2161e1-2cd1-466a-aaf5-5b5d3ffc7483 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] [instance: 806ac720-5f83-41ac-8053-3debfda5295d] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:12.108353 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c2161e1-2cd1-466a-aaf5-5b5d3ffc7483 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:12.108839 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c2161e1-2cd1-466a-aaf5-5b5d3ffc7483 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:12.109281 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c2161e1-2cd1-466a-aaf5-5b5d3ffc7483 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:12.109984 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c2161e1-2cd1-466a-aaf5-5b5d3ffc7483 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:12.110444 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c2161e1-2cd1-466a-aaf5-5b5d3ffc7483 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:12.110875 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c2161e1-2cd1-466a-aaf5-5b5d3ffc7483 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:12.125297 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-8c2161e1-2cd1-466a-aaf5-5b5d3ffc7483 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] HTTP exception thrown: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8c2161e1-2cd1-466a-aaf5-5b5d3ffc7483 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Request method failure captured: Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d HTTP/1.1 Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWWKG106_ye37k3Cc3N6VL7xjNtxZC6Z2Z1FBU4Q0VcVjnxhkf25XlB1qpGxx0dW38JLa-zrMhuoKgNq4y_H5VfBWkxmEn3b7hjbG5R-opms2i_s3X3OFnGoFIiChMZyEFAmYDMZOh8oyMKLRge1H0JCNzLR8Vvj3j-tdqRjPpTZ-Vs Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 20cdcff29a0448dc92460b2ddd45617b Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:27:12.126825 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:27:12.128467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20cdcff29a0448dc92460b2ddd45617b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:12.128467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:27:12.128467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 20cdcff29a0448dc92460b2ddd45617b Aug 30 01:27:12.128467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-TestVolumeBootPattern-1380496173 Aug 30 01:27:12.128467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-TestVolumeBootPattern-1380496173-project Aug 30 01:27:12.128467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:27:12.128467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:27:12.128467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 2839103f52324a1ab1ebd43fe230addc Aug 30 01:27:12.128467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-TestVolumeBootPattern-1380496173-project Aug 30 01:27:12.128467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:27:12.128467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:27:12.128467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '806ac720-5f83-41ac-8053-3debfda5295d'} Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:12.129352 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. Aug 30 01:27:12.131574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:12.132878 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8c2161e1-2cd1-466a-aaf5-5b5d3ffc7483 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Returning 404 to user: Instance 806ac720-5f83-41ac-8053-3debfda5295d could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:12.132878 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8c2161e1-2cd1-466a-aaf5-5b5d3ffc7483 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d" status: 404 len: 111 microversion: 2.1 time: 0.030602 Aug 30 01:27:12.132878 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 481/974] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:12 2022] GET /compute/v2.1/servers/806ac720-5f83-41ac-8053-3debfda5295d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:27:13.494156 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8b4b30a7-9007-4559-8d88-b37e20e72a22 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] Calling method '.version_select at 0x7ff48aeba5e0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:13.517861 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8b4b30a7-9007-4559-8d88-b37e20e72a22 tempest-TestVolumeBootPattern-1380496173 tempest-TestVolumeBootPattern-1380496173-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-799326755" status: 202 len: 0 microversion: 2.1 time: 0.028305 Aug 30 01:27:13.518692 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 494/975] 10.222.0.44 () {58 vars in 1260 bytes} [Tue Aug 30 01:27:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-799326755 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:27:16.560050 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-47a47b12-7295-4d5f-b350-b04d34633c6e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:16.560879 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-47a47b12-7295-4d5f-b350-b04d34633c6e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:16.567763 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47a47b12-7295-4d5f-b350-b04d34633c6e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:16.568292 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47a47b12-7295-4d5f-b350-b04d34633c6e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:16.569740 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47a47b12-7295-4d5f-b350-b04d34633c6e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:16.570477 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47a47b12-7295-4d5f-b350-b04d34633c6e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:16.570928 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47a47b12-7295-4d5f-b350-b04d34633c6e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:16.571347 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47a47b12-7295-4d5f-b350-b04d34633c6e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:16.595600 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-47a47b12-7295-4d5f-b350-b04d34633c6e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae/ips" status: 200 len: 151 microversion: 2.1 time: 0.039735 Aug 30 01:27:16.596201 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 482/976] 10.222.0.44 () {58 vars in 1248 bytes} [Tue Aug 30 01:27:16 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:27:17.999679 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6b16bd4e-0b57-45e6-bf07-6bda0ad2eda5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b34e0c8-556b-49a0-980b-79299c4043e9"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:27:18.002725 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6b16bd4e-0b57-45e6-bf07-6bda0ad2eda5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:18.011873 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b16bd4e-0b57-45e6-bf07-6bda0ad2eda5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:18.012410 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b16bd4e-0b57-45e6-bf07-6bda0ad2eda5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:18.012842 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b16bd4e-0b57-45e6-bf07-6bda0ad2eda5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:18.013734 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b16bd4e-0b57-45e6-bf07-6bda0ad2eda5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:18.014348 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b16bd4e-0b57-45e6-bf07-6bda0ad2eda5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:18.015945 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b16bd4e-0b57-45e6-bf07-6bda0ad2eda5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:18.319521 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6b16bd4e-0b57-45e6-bf07-6bda0ad2eda5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "POST /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324573 Aug 30 01:27:18.320078 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 495/977] 10.222.0.44 () {60 vars in 1323 bytes} [Tue Aug 30 01:27:17 2022] POST /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:27:26.034631 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ba2fb4ae-e6e5-4e23-8bfa-9d4eb2844b01 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:26.035140 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ba2fb4ae-e6e5-4e23-8bfa-9d4eb2844b01 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:26.037161 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:27:26.043253 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ba2fb4ae-e6e5-4e23-8bfa-9d4eb2844b01 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:26.043732 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ba2fb4ae-e6e5-4e23-8bfa-9d4eb2844b01 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:26.044194 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ba2fb4ae-e6e5-4e23-8bfa-9d4eb2844b01 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:26.044883 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ba2fb4ae-e6e5-4e23-8bfa-9d4eb2844b01 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:26.045327 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ba2fb4ae-e6e5-4e23-8bfa-9d4eb2844b01 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:26.045747 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ba2fb4ae-e6e5-4e23-8bfa-9d4eb2844b01 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:26.048822 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:27:26.130609 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-ba2fb4ae-e6e5-4e23-8bfa-9d4eb2844b01 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lazy-loading 'services' on Instance uuid 1b06926c-64dc-4def-b1e8-42f0c956caae {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:27:26.210364 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ba2fb4ae-e6e5-4e23-8bfa-9d4eb2844b01 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae/os-volume_attachments/2b34e0c8-556b-49a0-980b-79299c4043e9" status: 202 len: 0 microversion: 2.1 time: 0.179572 Aug 30 01:27:26.210955 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 483/978] 10.222.0.44 () {58 vars in 1416 bytes} [Tue Aug 30 01:27:26 2022] DELETE /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae/os-volume_attachments/2b34e0c8-556b-49a0-980b-79299c4043e9 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:27:26.221178 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-433746e1-977c-4ef5-9907-374093f8febd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:26.223404 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-433746e1-977c-4ef5-9907-374093f8febd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:26.225415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:27:26.232234 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-433746e1-977c-4ef5-9907-374093f8febd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:26.233021 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-433746e1-977c-4ef5-9907-374093f8febd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:26.233221 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-433746e1-977c-4ef5-9907-374093f8febd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:26.233849 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-433746e1-977c-4ef5-9907-374093f8febd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:26.234422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-433746e1-977c-4ef5-9907-374093f8febd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:26.234824 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-433746e1-977c-4ef5-9907-374093f8febd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:26.238440 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:27:26.269574 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-433746e1-977c-4ef5-9907-374093f8febd tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053526 Aug 30 01:27:26.270134 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 496/979] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:27:26 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:27:27.284910 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4510fd30-c4fd-43e3-9760-50669f13d3f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:27.287282 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4510fd30-c4fd-43e3-9760-50669f13d3f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:27.293809 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4510fd30-c4fd-43e3-9760-50669f13d3f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:27.294296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4510fd30-c4fd-43e3-9760-50669f13d3f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:27.294734 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4510fd30-c4fd-43e3-9760-50669f13d3f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:27.295432 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4510fd30-c4fd-43e3-9760-50669f13d3f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:27.295889 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4510fd30-c4fd-43e3-9760-50669f13d3f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:27.296350 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4510fd30-c4fd-43e3-9760-50669f13d3f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:27.326779 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4510fd30-c4fd-43e3-9760-50669f13d3f6 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047842 Aug 30 01:27:27.327338 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 484/980] 10.222.0.44 () {58 vars in 1302 bytes} [Tue Aug 30 01:27:27 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:27:27.389273 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2ab01e7e-bf18-4b74-8f1c-dc2975349b51 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:27.389777 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2ab01e7e-bf18-4b74-8f1c-dc2975349b51 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:27.396400 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ab01e7e-bf18-4b74-8f1c-dc2975349b51 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:27.396893 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ab01e7e-bf18-4b74-8f1c-dc2975349b51 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:27.397331 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ab01e7e-bf18-4b74-8f1c-dc2975349b51 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:27.398024 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ab01e7e-bf18-4b74-8f1c-dc2975349b51 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:27.398481 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ab01e7e-bf18-4b74-8f1c-dc2975349b51 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:27.399653 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ab01e7e-bf18-4b74-8f1c-dc2975349b51 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:27.424126 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2ab01e7e-bf18-4b74-8f1c-dc2975349b51 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:27:27.498510 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2ab01e7e-bf18-4b74-8f1c-dc2975349b51 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 204 len: 0 microversion: 2.1 time: 0.112792 Aug 30 01:27:27.499171 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 497/981] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:27:27 2022] DELETE /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:27:27.507493 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-551e8851-ca72-475d-b666-6ec3a44ab288 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:27.508903 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-551e8851-ca72-475d-b666-6ec3a44ab288 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:27.514979 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-551e8851-ca72-475d-b666-6ec3a44ab288 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:27.515459 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-551e8851-ca72-475d-b666-6ec3a44ab288 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:27.515891 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-551e8851-ca72-475d-b666-6ec3a44ab288 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:27.516603 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-551e8851-ca72-475d-b666-6ec3a44ab288 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:27.517049 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-551e8851-ca72-475d-b666-6ec3a44ab288 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:27.517472 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-551e8851-ca72-475d-b666-6ec3a44ab288 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:27.651220 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-551e8851-ca72-475d-b666-6ec3a44ab288 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:27:27.658994 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-551e8851-ca72-475d-b666-6ec3a44ab288 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1682 microversion: 2.1 time: 0.155408 Aug 30 01:27:27.659556 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 485/982] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:27 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:27:28.681330 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b2e283bb-ab40-4cf8-89ca-1dbe3d1b8728 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:28.682133 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b2e283bb-ab40-4cf8-89ca-1dbe3d1b8728 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:28.688852 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b2e283bb-ab40-4cf8-89ca-1dbe3d1b8728 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:28.689605 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b2e283bb-ab40-4cf8-89ca-1dbe3d1b8728 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:28.690047 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b2e283bb-ab40-4cf8-89ca-1dbe3d1b8728 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:28.690760 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b2e283bb-ab40-4cf8-89ca-1dbe3d1b8728 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:28.691214 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b2e283bb-ab40-4cf8-89ca-1dbe3d1b8728 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:28.691644 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b2e283bb-ab40-4cf8-89ca-1dbe3d1b8728 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:28.883504 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b2e283bb-ab40-4cf8-89ca-1dbe3d1b8728 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:27:28.892510 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b2e283bb-ab40-4cf8-89ca-1dbe3d1b8728 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1682 microversion: 2.1 time: 0.215814 Aug 30 01:27:28.893095 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 498/983] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:28 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:27:29.913466 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4e608efd-f4f9-4760-84e3-3540f6cc175c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:29.914243 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4e608efd-f4f9-4760-84e3-3540f6cc175c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:29.921113 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e608efd-f4f9-4760-84e3-3540f6cc175c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:29.921728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e608efd-f4f9-4760-84e3-3540f6cc175c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:29.922229 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e608efd-f4f9-4760-84e3-3540f6cc175c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:29.923019 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e608efd-f4f9-4760-84e3-3540f6cc175c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:29.923537 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e608efd-f4f9-4760-84e3-3540f6cc175c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:29.924039 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e608efd-f4f9-4760-84e3-3540f6cc175c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:30.021747 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4e608efd-f4f9-4760-84e3-3540f6cc175c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:27:30.033698 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4e608efd-f4f9-4760-84e3-3540f6cc175c tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1615 microversion: 2.1 time: 0.123966 Aug 30 01:27:30.034342 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 486/984] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:29 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1615 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:27:30.305348 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-baee7e31-2c03-4808-bf4a-b1674647764a req-045d25ae-e112-45cd-b9eb-14527058fec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b06926c-64dc-4def-b1e8-42f0c956caae", "name": "network-vif-deleted", "tag": "3f05a184-fab7-4698-9752-f997cdccbd61"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:27:30.316711 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-baee7e31-2c03-4808-bf4a-b1674647764a req-045d25ae-e112-45cd-b9eb-14527058fec1 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:30.317195 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-baee7e31-2c03-4808-bf4a-b1674647764a req-045d25ae-e112-45cd-b9eb-14527058fec1 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:30.317818 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-baee7e31-2c03-4808-bf4a-b1674647764a req-045d25ae-e112-45cd-b9eb-14527058fec1 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:30.336118 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-baee7e31-2c03-4808-bf4a-b1674647764a req-045d25ae-e112-45cd-b9eb-14527058fec1 service nova] Creating event network-vif-deleted:3f05a184-fab7-4698-9752-f997cdccbd61 for instance 1b06926c-64dc-4def-b1e8-42f0c956caae on hv-cinder-81514 Aug 30 01:27:30.342647 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-baee7e31-2c03-4808-bf4a-b1674647764a req-045d25ae-e112-45cd-b9eb-14527058fec1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040796 Aug 30 01:27:30.348991 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 499/985] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:27:31.056876 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:31.058331 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:31.067181 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:31.067678 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:31.068298 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:31.074026 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:31.074827 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:31.075379 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:31.128934 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:31.129529 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:31.130086 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:31.130613 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lazy-loading 'fault' on Instance uuid 1b06926c-64dc-4def-b1e8-42f0c956caae {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:27:31.179227 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe36a87392c40379ac160ebaa3cd84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ddbf041c444253aea027770188fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:27:31.186981 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d0c02948-ef6a-4bd9-aea1-68df0f6e87e1 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 200 len: 1331 microversion: 2.1 time: 0.135620 Aug 30 01:27:31.187555 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 487/986] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:31 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 1331 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:27:32.209776 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4aafd191-4cb7-4010-86dd-03647253681e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:32.210491 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4aafd191-4cb7-4010-86dd-03647253681e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:32.217072 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4aafd191-4cb7-4010-86dd-03647253681e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:32.217545 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4aafd191-4cb7-4010-86dd-03647253681e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:32.217971 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4aafd191-4cb7-4010-86dd-03647253681e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:32.218729 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4aafd191-4cb7-4010-86dd-03647253681e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:32.219083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4aafd191-4cb7-4010-86dd-03647253681e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:32.219497 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4aafd191-4cb7-4010-86dd-03647253681e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:32.233418 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-4aafd191-4cb7-4010-86dd-03647253681e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4aafd191-4cb7-4010-86dd-03647253681e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae HTTP/1.1 Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:27:32.235044 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:27:32.236753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:32.236753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:32.236753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:32.236753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:32.236753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:32.236753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:27:32.236753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:27:32.236753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:27:32.236753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:32.236753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:27:32.236753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:32.236753 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '1b06926c-64dc-4def-b1e8-42f0c956caae'} Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:32.237673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:32.239131 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:32.240814 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4aafd191-4cb7-4010-86dd-03647253681e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 404 to user: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:32.240814 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4aafd191-4cb7-4010-86dd-03647253681e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 404 len: 111 microversion: 2.1 time: 0.031335 Aug 30 01:27:32.240814 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 500/987] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:32 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:27:32.245704 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b71c8540-4471-4063-b62e-dbb033952316 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '.version_select at 0x7ff48aee6a60>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:32.266595 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b71c8540-4471-4063-b62e-dbb033952316 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-745746834" status: 202 len: 0 microversion: 2.1 time: 0.024906 Aug 30 01:27:32.270854 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 488/988] 10.222.0.44 () {58 vars in 1218 bytes} [Tue Aug 30 01:27:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-745746834 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:27:34.081813 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-65e194ec-2055-444d-9be9-9f9a8789b715 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:34.082311 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-65e194ec-2055-444d-9be9-9f9a8789b715 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:34.088992 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-65e194ec-2055-444d-9be9-9f9a8789b715 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:34.089473 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-65e194ec-2055-444d-9be9-9f9a8789b715 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:34.089913 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-65e194ec-2055-444d-9be9-9f9a8789b715 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:34.090613 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-65e194ec-2055-444d-9be9-9f9a8789b715 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:34.091067 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-65e194ec-2055-444d-9be9-9f9a8789b715 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:34.091490 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-65e194ec-2055-444d-9be9-9f9a8789b715 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:34.105301 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-65e194ec-2055-444d-9be9-9f9a8789b715 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-65e194ec-2055-444d-9be9-9f9a8789b715 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae HTTP/1.1 Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:27:34.107083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:27:34.108955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:34.108955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:34.108955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:34.108955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:34.108955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:34.108955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:27:34.108955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:27:34.108955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:27:34.108955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:34.108955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:27:34.108955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:34.108955 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '1b06926c-64dc-4def-b1e8-42f0c956caae'} Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:34.109892 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:34.111228 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:34.112773 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-65e194ec-2055-444d-9be9-9f9a8789b715 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 404 to user: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:34.112773 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-65e194ec-2055-444d-9be9-9f9a8789b715 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 404 len: 111 microversion: 2.1 time: 0.030803 Aug 30 01:27:34.112773 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 501/989] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:27:34 2022] DELETE /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:27:34.118451 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e0913f6f-7a5b-4896-960a-6b57270624fb tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:34.119744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e0913f6f-7a5b-4896-960a-6b57270624fb tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1b06926c-64dc-4def-b1e8-42f0c956caae] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:34.126703 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0913f6f-7a5b-4896-960a-6b57270624fb tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:34.127189 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0913f6f-7a5b-4896-960a-6b57270624fb tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:34.127623 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0913f6f-7a5b-4896-960a-6b57270624fb tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:34.128344 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0913f6f-7a5b-4896-960a-6b57270624fb tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:34.128797 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0913f6f-7a5b-4896-960a-6b57270624fb tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:34.129226 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0913f6f-7a5b-4896-960a-6b57270624fb tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:34.143563 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-e0913f6f-7a5b-4896-960a-6b57270624fb tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e0913f6f-7a5b-4896-960a-6b57270624fb tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae HTTP/1.1 Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:27:34.145239 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:27:34.146796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:34.146796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:34.146796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:34.146796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:34.146796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:34.146796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:27:34.146796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:27:34.146796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:27:34.146796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:34.146796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:27:34.146796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:34.146796 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '1b06926c-64dc-4def-b1e8-42f0c956caae'} Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:34.147644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. Aug 30 01:27:34.148897 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:34.149988 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e0913f6f-7a5b-4896-960a-6b57270624fb tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 404 to user: Instance 1b06926c-64dc-4def-b1e8-42f0c956caae could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:34.149988 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e0913f6f-7a5b-4896-960a-6b57270624fb tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae" status: 404 len: 111 microversion: 2.1 time: 0.032509 Aug 30 01:27:34.149988 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 489/990] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:34 2022] GET /compute/v2.1/servers/1b06926c-64dc-4def-b1e8-42f0c956caae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:27:37.402236 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-532c04a5-4b5b-4c63-83b1-c8ee8d7a955b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:37.402746 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-532c04a5-4b5b-4c63-83b1-c8ee8d7a955b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:37.409160 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-532c04a5-4b5b-4c63-83b1-c8ee8d7a955b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:37.409643 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-532c04a5-4b5b-4c63-83b1-c8ee8d7a955b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:37.410083 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-532c04a5-4b5b-4c63-83b1-c8ee8d7a955b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:37.410774 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-532c04a5-4b5b-4c63-83b1-c8ee8d7a955b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:37.411237 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-532c04a5-4b5b-4c63-83b1-c8ee8d7a955b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:37.411658 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-532c04a5-4b5b-4c63-83b1-c8ee8d7a955b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:37.425801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-532c04a5-4b5b-4c63-83b1-c8ee8d7a955b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-532c04a5-4b5b-4c63-83b1-c8ee8d7a955b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 HTTP/1.1 Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:27:37.427735 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:27:37.429388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:37.429388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:37.429388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:37.429388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:37.429388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:37.429388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:27:37.429388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:27:37.429388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:27:37.429388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:37.429388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:27:37.429388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:27:37.429388 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '0b8c9b12-8dc1-4e3d-988c-12717b48b0b9'} Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:37.430298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:27:37.431857 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.434122 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-532c04a5-4b5b-4c63-83b1-c8ee8d7a955b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 404 to user: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:37.434122 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-532c04a5-4b5b-4c63-83b1-c8ee8d7a955b tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 404 len: 111 microversion: 2.1 time: 0.031304 Aug 30 01:27:37.434122 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 502/991] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:27:37 2022] DELETE /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:27:37.438705 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9a555feb-b7c5-4f3a-88c2-34521d013e68 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:37.439322 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9a555feb-b7c5-4f3a-88c2-34521d013e68 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:37.445921 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a555feb-b7c5-4f3a-88c2-34521d013e68 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:37.446394 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a555feb-b7c5-4f3a-88c2-34521d013e68 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:37.446823 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a555feb-b7c5-4f3a-88c2-34521d013e68 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:37.447511 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a555feb-b7c5-4f3a-88c2-34521d013e68 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:37.448821 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a555feb-b7c5-4f3a-88c2-34521d013e68 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:37.449246 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a555feb-b7c5-4f3a-88c2-34521d013e68 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:37.462374 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-9a555feb-b7c5-4f3a-88c2-34521d013e68 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9a555feb-b7c5-4f3a-88c2-34521d013e68 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 HTTP/1.1 Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:27:37.463871 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:27:37.465487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:37.465487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:37.465487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:37.465487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:37.465487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:37.465487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:27:37.465487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:27:37.465487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:27:37.465487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:37.465487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:27:37.465487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:27:37.465487 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '0b8c9b12-8dc1-4e3d-988c-12717b48b0b9'} Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:37.466369 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. Aug 30 01:27:37.467691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.468801 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9a555feb-b7c5-4f3a-88c2-34521d013e68 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 404 to user: Instance 0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:37.468801 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9a555feb-b7c5-4f3a-88c2-34521d013e68 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9" status: 404 len: 111 microversion: 2.1 time: 0.030410 Aug 30 01:27:37.468801 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 490/992] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:37 2022] GET /compute/v2.1/servers/0b8c9b12-8dc1-4e3d-988c-12717b48b0b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:27:37.473702 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3fb8b165-b865-419d-bf3f-3b672445210e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:37.474189 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3fb8b165-b865-419d-bf3f-3b672445210e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:37.481239 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3fb8b165-b865-419d-bf3f-3b672445210e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:37.481724 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3fb8b165-b865-419d-bf3f-3b672445210e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:37.482328 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3fb8b165-b865-419d-bf3f-3b672445210e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:37.483023 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3fb8b165-b865-419d-bf3f-3b672445210e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:37.483471 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3fb8b165-b865-419d-bf3f-3b672445210e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:37.483893 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3fb8b165-b865-419d-bf3f-3b672445210e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:37.498452 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-3fb8b165-b865-419d-bf3f-3b672445210e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3fb8b165-b865-419d-bf3f-3b672445210e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 HTTP/1.1 Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:27:37.499986 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:27:37.501618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:37.501618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:37.501618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:37.501618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:37.501618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:37.501618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:27:37.501618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:27:37.501618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:27:37.501618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:37.501618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:27:37.501618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:27:37.501618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '1f305831-eafb-4667-a621-cb2bf89c07c1'} Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:37.502568 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:27:37.504139 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.505809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3fb8b165-b865-419d-bf3f-3b672445210e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 404 to user: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:37.505809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3fb8b165-b865-419d-bf3f-3b672445210e tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 404 len: 111 microversion: 2.1 time: 0.031549 Aug 30 01:27:37.505809 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 503/993] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:27:37 2022] DELETE /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:27:37.509792 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1d44d3da-2dbf-46f6-8077-8dd7f1319d57 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:37.511171 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1d44d3da-2dbf-46f6-8077-8dd7f1319d57 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 1f305831-eafb-4667-a621-cb2bf89c07c1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:37.517222 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1d44d3da-2dbf-46f6-8077-8dd7f1319d57 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:37.517702 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1d44d3da-2dbf-46f6-8077-8dd7f1319d57 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:37.518135 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1d44d3da-2dbf-46f6-8077-8dd7f1319d57 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:37.518826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1d44d3da-2dbf-46f6-8077-8dd7f1319d57 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:37.519279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1d44d3da-2dbf-46f6-8077-8dd7f1319d57 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:37.519699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1d44d3da-2dbf-46f6-8077-8dd7f1319d57 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:37.533245 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-1d44d3da-2dbf-46f6-8077-8dd7f1319d57 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1d44d3da-2dbf-46f6-8077-8dd7f1319d57 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 HTTP/1.1 Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:27:37.534754 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:27:37.536393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:37.536393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:37.536393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:37.536393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:37.536393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:37.536393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:27:37.536393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:27:37.536393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:27:37.536393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:37.536393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:27:37.536393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:27:37.536393 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '1f305831-eafb-4667-a621-cb2bf89c07c1'} Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:37.537290 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. Aug 30 01:27:37.538728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:37.540065 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1d44d3da-2dbf-46f6-8077-8dd7f1319d57 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 404 to user: Instance 1f305831-eafb-4667-a621-cb2bf89c07c1 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:37.540065 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1d44d3da-2dbf-46f6-8077-8dd7f1319d57 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1" status: 404 len: 111 microversion: 2.1 time: 0.030176 Aug 30 01:27:37.540065 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 491/994] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:37 2022] GET /compute/v2.1/servers/1f305831-eafb-4667-a621-cb2bf89c07c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:27:40.780864 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-89487e5b-1e9c-498a-8627-4736cbbea0ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:40.781380 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-89487e5b-1e9c-498a-8627-4736cbbea0ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:40.788164 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89487e5b-1e9c-498a-8627-4736cbbea0ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:40.788732 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89487e5b-1e9c-498a-8627-4736cbbea0ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:40.789193 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89487e5b-1e9c-498a-8627-4736cbbea0ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:40.789887 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89487e5b-1e9c-498a-8627-4736cbbea0ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:40.790397 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89487e5b-1e9c-498a-8627-4736cbbea0ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:40.790853 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89487e5b-1e9c-498a-8627-4736cbbea0ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:40.805129 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-89487e5b-1e9c-498a-8627-4736cbbea0ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-89487e5b-1e9c-498a-8627-4736cbbea0ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 HTTP/1.1 Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:27:40.806789 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:27:40.808431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:40.808431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:40.808431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:40.808431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:40.808431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:40.808431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:27:40.808431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:27:40.808431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:27:40.808431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:40.808431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:27:40.808431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:27:40.808431 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1'} Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:40.809303 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:27:40.810801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:27:40.813145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-89487e5b-1e9c-498a-8627-4736cbbea0ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 404 to user: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:40.813145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-89487e5b-1e9c-498a-8627-4736cbbea0ad tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 404 len: 111 microversion: 2.1 time: 0.032299 Aug 30 01:27:40.813145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 504/995] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:27:40 2022] DELETE /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:27:40.818169 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4aa24143-4305-4f4d-bf1a-a3bcacc9cfb5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:27:40.818816 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4aa24143-4305-4f4d-bf1a-a3bcacc9cfb5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] [instance: 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:27:40.825983 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4aa24143-4305-4f4d-bf1a-a3bcacc9cfb5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:40.826468 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4aa24143-4305-4f4d-bf1a-a3bcacc9cfb5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:40.826906 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4aa24143-4305-4f4d-bf1a-a3bcacc9cfb5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:40.827608 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4aa24143-4305-4f4d-bf1a-a3bcacc9cfb5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:27:40.828084 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4aa24143-4305-4f4d-bf1a-a3bcacc9cfb5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:27:40.828513 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4aa24143-4305-4f4d-bf1a-a3bcacc9cfb5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:27:40.842816 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-4aa24143-4305-4f4d-bf1a-a3bcacc9cfb5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] HTTP exception thrown: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4aa24143-4305-4f4d-bf1a-a3bcacc9cfb5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Request method failure captured: Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 HTTP/1.1 Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWZ1soUoHY9lRs_ew0cRkZzl93AyaucsRNQy3jxyUxVm4eED2pvgbLd0ZBGMuSKD_JyyOOhnlwpJPvl-mzVSpPVrz8ppd3TlG1r7gxmJWLd3ituRPLpymn9WDnic0m1LrxOjDIDdnROMn9gNkgvKk06QHS_Txc7jXDWyAm0GLCRfArw Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:27:40.844999 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:27:40.847033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f5ddbf041c444253aea027770188fbaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f5ddbf041c444253aea027770188fbaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:27:40.847033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:40.847033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: f5ddbf041c444253aea027770188fbaf Aug 30 01:27:40.847033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533918019 Aug 30 01:27:40.847033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:40.847033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:27:40.847033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:27:40.847033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 4fe36a87392c40379ac160ebaa3cd84c Aug 30 01:27:40.847033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeNegativeTest-533918019-project Aug 30 01:27:40.847033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:27:40.847033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:27:40.847033 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1'} Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:27:40.848230 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. Aug 30 01:27:40.849744 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:27:40.851072 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4aa24143-4305-4f4d-bf1a-a3bcacc9cfb5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] Returning 404 to user: Instance 4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:27:40.851072 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4aa24143-4305-4f4d-bf1a-a3bcacc9cfb5 tempest-AttachVolumeNegativeTest-533918019 tempest-AttachVolumeNegativeTest-533918019-project] 10.222.0.44 "GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1" status: 404 len: 111 microversion: 2.1 time: 0.032240 Aug 30 01:27:40.851072 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 492/996] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:27:40 2022] GET /compute/v2.1/servers/4bfcbf9a-3c64-47d2-9f83-3e29ae9321b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:28:18.347211 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1699483634", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "networks": [{"uuid": "d538ef8f-d46e-45fe-b473-078cdd576896"}]}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:28:18.355740 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:18.356458 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:18.409832 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] validate_networks() for [('d538ef8f-d46e-45fe-b473-078cdd576896', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:28:18.827295 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:28:18.827749 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:28:18.828267 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:28:18.829221 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:28:18.829435 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:28:18.840145 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:18.840626 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:18.841055 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:18.841777 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:18.842226 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:18.842643 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:18.859679 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Getting quotas for project 6daea8caca73411abef8e14de09c5c54. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:28:18.863729 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Getting quotas for user 282e92776c594100b697a79d0209be00 and project 6daea8caca73411abef8e14de09c5c54. Resources: {'ram', 'instances', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:28:18.874906 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:28:18.877235 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:28:18.926067 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3076eaf1-f835-4410-ad69-a99b69767499 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583476 Aug 30 01:28:18.926894 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 505/997] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:28:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:28:18.938210 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ccd59691-dd93-4477-a27d-14fddc8053f6 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:18.938836 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ccd59691-dd93-4477-a27d-14fddc8053f6 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:18.942751 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:18.943953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:18.999909 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ccd59691-dd93-4477-a27d-14fddc8053f6 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:19.009795 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ccd59691-dd93-4477-a27d-14fddc8053f6 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 200 len: 1214 microversion: 2.1 time: 0.076016 Aug 30 01:28:19.010820 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 493/998] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:18 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:20.031610 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9016330c-af9b-4853-bed6-e42905f7000b tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:20.032258 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9016330c-af9b-4853-bed6-e42905f7000b tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:20.039273 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9016330c-af9b-4853-bed6-e42905f7000b tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:20.039751 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9016330c-af9b-4853-bed6-e42905f7000b tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:20.040212 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9016330c-af9b-4853-bed6-e42905f7000b tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:20.040900 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9016330c-af9b-4853-bed6-e42905f7000b tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:20.041347 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9016330c-af9b-4853-bed6-e42905f7000b tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:20.041764 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9016330c-af9b-4853-bed6-e42905f7000b tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:20.107632 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9016330c-af9b-4853-bed6-e42905f7000b tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:20.118301 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9016330c-af9b-4853-bed6-e42905f7000b tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 200 len: 1266 microversion: 2.1 time: 0.091178 Aug 30 01:28:20.128177 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 506/999] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:20 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:21.140812 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2713a5cf-ebc9-4801-aecc-b3dbbaefb372 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:21.141531 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2713a5cf-ebc9-4801-aecc-b3dbbaefb372 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:21.149963 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2713a5cf-ebc9-4801-aecc-b3dbbaefb372 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:21.150592 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2713a5cf-ebc9-4801-aecc-b3dbbaefb372 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:21.151030 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2713a5cf-ebc9-4801-aecc-b3dbbaefb372 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:21.151728 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2713a5cf-ebc9-4801-aecc-b3dbbaefb372 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:21.152208 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2713a5cf-ebc9-4801-aecc-b3dbbaefb372 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:21.152635 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2713a5cf-ebc9-4801-aecc-b3dbbaefb372 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:21.359392 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2713a5cf-ebc9-4801-aecc-b3dbbaefb372 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:21.368291 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2713a5cf-ebc9-4801-aecc-b3dbbaefb372 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 200 len: 1314 microversion: 2.1 time: 0.231769 Aug 30 01:28:21.368795 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 494/1000] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:21 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:21.435407 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-018e7fce-690c-4c94-a3b7-09a0d1b7a33d req-7fa17803-571c-451f-8317-13ab0e22f143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99988bea-c46f-4a9e-a1c0-06a90a3ab7e8", "tag": "68488a9d-1f8b-4db7-8141-f0f8a02d1ab6"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:28:21.446972 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-018e7fce-690c-4c94-a3b7-09a0d1b7a33d req-7fa17803-571c-451f-8317-13ab0e22f143 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:21.447534 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-018e7fce-690c-4c94-a3b7-09a0d1b7a33d req-7fa17803-571c-451f-8317-13ab0e22f143 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:21.448058 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-018e7fce-690c-4c94-a3b7-09a0d1b7a33d req-7fa17803-571c-451f-8317-13ab0e22f143 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:21.459398 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-018e7fce-690c-4c94-a3b7-09a0d1b7a33d req-7fa17803-571c-451f-8317-13ab0e22f143 service nova] Creating event network-changed:68488a9d-1f8b-4db7-8141-f0f8a02d1ab6 for instance 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 on hv-cinder-81514 Aug 30 01:28:21.464571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-018e7fce-690c-4c94-a3b7-09a0d1b7a33d req-7fa17803-571c-451f-8317-13ab0e22f143 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032970 Aug 30 01:28:21.465163 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 507/1001] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:28:22.390083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cbba7986-98ae-4242-9c3f-e4a9e15c194c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:22.390699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cbba7986-98ae-4242-9c3f-e4a9e15c194c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:22.397303 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cbba7986-98ae-4242-9c3f-e4a9e15c194c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:22.397798 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cbba7986-98ae-4242-9c3f-e4a9e15c194c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:22.398234 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cbba7986-98ae-4242-9c3f-e4a9e15c194c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:22.398933 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cbba7986-98ae-4242-9c3f-e4a9e15c194c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:22.399390 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cbba7986-98ae-4242-9c3f-e4a9e15c194c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:22.400515 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cbba7986-98ae-4242-9c3f-e4a9e15c194c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:22.532440 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cbba7986-98ae-4242-9c3f-e4a9e15c194c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:22.541379 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cbba7986-98ae-4242-9c3f-e4a9e15c194c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 200 len: 1314 microversion: 2.1 time: 0.155282 Aug 30 01:28:22.541955 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 495/1002] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:22 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:23.563378 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f2410139-7a01-463f-859a-97c14b994f90 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:23.564104 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f2410139-7a01-463f-859a-97c14b994f90 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:23.570874 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2410139-7a01-463f-859a-97c14b994f90 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:23.571360 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2410139-7a01-463f-859a-97c14b994f90 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:23.571801 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2410139-7a01-463f-859a-97c14b994f90 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:23.572522 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2410139-7a01-463f-859a-97c14b994f90 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:23.572980 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2410139-7a01-463f-859a-97c14b994f90 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:23.573407 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f2410139-7a01-463f-859a-97c14b994f90 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:23.707396 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f2410139-7a01-463f-859a-97c14b994f90 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:23.718146 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f2410139-7a01-463f-859a-97c14b994f90 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 200 len: 1314 microversion: 2.1 time: 0.159014 Aug 30 01:28:23.719057 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 508/1003] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:23 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:24.739784 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-abcb5b8b-0e62-4303-a717-cbb15fbe1a7d tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:24.740423 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-abcb5b8b-0e62-4303-a717-cbb15fbe1a7d tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:24.746855 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-abcb5b8b-0e62-4303-a717-cbb15fbe1a7d tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:24.747441 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-abcb5b8b-0e62-4303-a717-cbb15fbe1a7d tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:24.747899 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-abcb5b8b-0e62-4303-a717-cbb15fbe1a7d tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:24.748642 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-abcb5b8b-0e62-4303-a717-cbb15fbe1a7d tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:24.749130 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-abcb5b8b-0e62-4303-a717-cbb15fbe1a7d tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:24.749532 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-abcb5b8b-0e62-4303-a717-cbb15fbe1a7d tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:24.878481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-abcb5b8b-0e62-4303-a717-cbb15fbe1a7d tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:24.886725 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-abcb5b8b-0e62-4303-a717-cbb15fbe1a7d tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 200 len: 1314 microversion: 2.1 time: 0.151505 Aug 30 01:28:24.887294 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 496/1004] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:24 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:25.906808 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ef737fe3-92c6-407d-be7c-dee6f4f76edf tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:25.907437 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ef737fe3-92c6-407d-be7c-dee6f4f76edf tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:25.914597 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef737fe3-92c6-407d-be7c-dee6f4f76edf tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:25.915081 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef737fe3-92c6-407d-be7c-dee6f4f76edf tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:25.915521 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef737fe3-92c6-407d-be7c-dee6f4f76edf tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:25.916241 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef737fe3-92c6-407d-be7c-dee6f4f76edf tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:25.916697 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef737fe3-92c6-407d-be7c-dee6f4f76edf tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:25.917123 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ef737fe3-92c6-407d-be7c-dee6f4f76edf tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:26.050339 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ef737fe3-92c6-407d-be7c-dee6f4f76edf tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:26.057948 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ef737fe3-92c6-407d-be7c-dee6f4f76edf tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 200 len: 1314 microversion: 2.1 time: 0.155031 Aug 30 01:28:26.058496 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 509/1005] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:25 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:27.079502 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-20e614b0-eaa7-49f4-baf4-5409f837b800 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:27.080246 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-20e614b0-eaa7-49f4-baf4-5409f837b800 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:27.086820 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-20e614b0-eaa7-49f4-baf4-5409f837b800 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:27.087549 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-20e614b0-eaa7-49f4-baf4-5409f837b800 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:27.088265 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-20e614b0-eaa7-49f4-baf4-5409f837b800 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:27.089158 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-20e614b0-eaa7-49f4-baf4-5409f837b800 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:27.089777 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-20e614b0-eaa7-49f4-baf4-5409f837b800 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:27.090046 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-20e614b0-eaa7-49f4-baf4-5409f837b800 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:27.148748 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-34b5311f-ef0f-4476-a4e5-b24eae75cc86 req-aa4d75d0-7363-43ba-ab4a-0caf559cb3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99988bea-c46f-4a9e-a1c0-06a90a3ab7e8", "name": "network-vif-plugged", "status": "completed", "tag": "68488a9d-1f8b-4db7-8141-f0f8a02d1ab6"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:28:27.158108 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-34b5311f-ef0f-4476-a4e5-b24eae75cc86 req-aa4d75d0-7363-43ba-ab4a-0caf559cb3e2 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:27.158606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-34b5311f-ef0f-4476-a4e5-b24eae75cc86 req-aa4d75d0-7363-43ba-ab4a-0caf559cb3e2 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:27.159003 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-34b5311f-ef0f-4476-a4e5-b24eae75cc86 req-aa4d75d0-7363-43ba-ab4a-0caf559cb3e2 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:27.170548 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-34b5311f-ef0f-4476-a4e5-b24eae75cc86 req-aa4d75d0-7363-43ba-ab4a-0caf559cb3e2 service nova] Creating event network-vif-plugged:68488a9d-1f8b-4db7-8141-f0f8a02d1ab6 for instance 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 on hv-cinder-81514 Aug 30 01:28:27.178576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-34b5311f-ef0f-4476-a4e5-b24eae75cc86 req-aa4d75d0-7363-43ba-ab4a-0caf559cb3e2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157960 Aug 30 01:28:27.178576 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 497/1006] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:28:27.229741 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-20e614b0-eaa7-49f4-baf4-5409f837b800 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:27.238053 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-20e614b0-eaa7-49f4-baf4-5409f837b800 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 200 len: 1314 microversion: 2.1 time: 0.162260 Aug 30 01:28:27.238703 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 510/1007] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:27 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:28:28.263939 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d087e520-ae25-4d78-90e8-081850b6d145 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:28.264667 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d087e520-ae25-4d78-90e8-081850b6d145 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:28.271329 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d087e520-ae25-4d78-90e8-081850b6d145 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:28.271823 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d087e520-ae25-4d78-90e8-081850b6d145 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:28.272319 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d087e520-ae25-4d78-90e8-081850b6d145 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:28.273048 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d087e520-ae25-4d78-90e8-081850b6d145 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:28.273534 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d087e520-ae25-4d78-90e8-081850b6d145 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:28.273963 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d087e520-ae25-4d78-90e8-081850b6d145 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:28.405826 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d087e520-ae25-4d78-90e8-081850b6d145 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:28.414326 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d087e520-ae25-4d78-90e8-081850b6d145 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 200 len: 1314 microversion: 2.1 time: 0.158403 Aug 30 01:28:28.414893 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 498/1008] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:28 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:28:29.434868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-55a91f89-6d39-46ae-b211-c54f384949ae tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:29.435489 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-55a91f89-6d39-46ae-b211-c54f384949ae tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:29.439206 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:29.440186 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:29.445588 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55a91f89-6d39-46ae-b211-c54f384949ae tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:29.446076 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55a91f89-6d39-46ae-b211-c54f384949ae tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:29.446522 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55a91f89-6d39-46ae-b211-c54f384949ae tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:29.447345 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55a91f89-6d39-46ae-b211-c54f384949ae tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:29.447808 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55a91f89-6d39-46ae-b211-c54f384949ae tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:29.448271 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55a91f89-6d39-46ae-b211-c54f384949ae tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:29.580420 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-55a91f89-6d39-46ae-b211-c54f384949ae tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:29.588742 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-55a91f89-6d39-46ae-b211-c54f384949ae tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 200 len: 1497 microversion: 2.1 time: 0.157956 Aug 30 01:28:29.589304 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 511/1009] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:29 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:30.059815 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a473e9cc-755e-4dda-bcfc-5785d3330cec tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:30.060387 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a473e9cc-755e-4dda-bcfc-5785d3330cec tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:30.062443 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:30.068737 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a473e9cc-755e-4dda-bcfc-5785d3330cec tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:30.069224 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a473e9cc-755e-4dda-bcfc-5785d3330cec tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:30.069664 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a473e9cc-755e-4dda-bcfc-5785d3330cec tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:30.070360 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a473e9cc-755e-4dda-bcfc-5785d3330cec tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:30.070834 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a473e9cc-755e-4dda-bcfc-5785d3330cec tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:30.071248 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a473e9cc-755e-4dda-bcfc-5785d3330cec tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:30.096483 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a473e9cc-755e-4dda-bcfc-5785d3330cec tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:28:30.174182 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a473e9cc-755e-4dda-bcfc-5785d3330cec tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "DELETE /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 204 len: 0 microversion: 2.1 time: 0.118800 Aug 30 01:28:30.174761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 499/1010] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:28:30 2022] DELETE /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:28:30.184198 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cdd4cf7a-0039-4f79-ac48-ebe806c6eac4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:30.184810 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cdd4cf7a-0039-4f79-ac48-ebe806c6eac4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:30.192699 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cdd4cf7a-0039-4f79-ac48-ebe806c6eac4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:30.193186 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cdd4cf7a-0039-4f79-ac48-ebe806c6eac4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:30.193622 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cdd4cf7a-0039-4f79-ac48-ebe806c6eac4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:30.194321 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cdd4cf7a-0039-4f79-ac48-ebe806c6eac4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:30.194775 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cdd4cf7a-0039-4f79-ac48-ebe806c6eac4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:30.195201 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cdd4cf7a-0039-4f79-ac48-ebe806c6eac4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:30.322383 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-cdd4cf7a-0039-4f79-ac48-ebe806c6eac4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:30.336105 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cdd4cf7a-0039-4f79-ac48-ebe806c6eac4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 200 len: 1503 microversion: 2.1 time: 0.156819 Aug 30 01:28:30.336693 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 512/1011] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:30 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:31.358057 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9b8b8b8e-2041-44c2-a11d-f1b1b5fb2f93 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:31.358801 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9b8b8b8e-2041-44c2-a11d-f1b1b5fb2f93 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:31.366915 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b8e-2041-44c2-a11d-f1b1b5fb2f93 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:31.367403 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b8e-2041-44c2-a11d-f1b1b5fb2f93 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:31.367841 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b8e-2041-44c2-a11d-f1b1b5fb2f93 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:31.368574 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b8e-2041-44c2-a11d-f1b1b5fb2f93 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:31.369026 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b8e-2041-44c2-a11d-f1b1b5fb2f93 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:31.369449 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b8e-2041-44c2-a11d-f1b1b5fb2f93 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:31.501306 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9b8b8b8e-2041-44c2-a11d-f1b1b5fb2f93 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:31.510197 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9b8b8b8e-2041-44c2-a11d-f1b1b5fb2f93 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 200 len: 1503 microversion: 2.1 time: 0.156393 Aug 30 01:28:31.510761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 500/1012] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:31 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:32.204160 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-5418a48b-c901-46c4-ab85-f269c578f6ea req-b3da1822-2c18-479f-bce1-d8cdf5af6670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99988bea-c46f-4a9e-a1c0-06a90a3ab7e8", "name": "network-vif-deleted", "tag": "68488a9d-1f8b-4db7-8141-f0f8a02d1ab6"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:28:32.214313 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-5418a48b-c901-46c4-ab85-f269c578f6ea req-b3da1822-2c18-479f-bce1-d8cdf5af6670 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:32.214787 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-5418a48b-c901-46c4-ab85-f269c578f6ea req-b3da1822-2c18-479f-bce1-d8cdf5af6670 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:32.215210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-5418a48b-c901-46c4-ab85-f269c578f6ea req-b3da1822-2c18-479f-bce1-d8cdf5af6670 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:32.227249 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-5418a48b-c901-46c4-ab85-f269c578f6ea req-b3da1822-2c18-479f-bce1-d8cdf5af6670 service nova] Creating event network-vif-deleted:68488a9d-1f8b-4db7-8141-f0f8a02d1ab6 for instance 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 on hv-cinder-81514 Aug 30 01:28:32.232226 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-5418a48b-c901-46c4-ab85-f269c578f6ea req-b3da1822-2c18-479f-bce1-d8cdf5af6670 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031748 Aug 30 01:28:32.233151 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 513/1013] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:28:32.530892 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:32.531418 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:32.538481 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:32.538966 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:32.539402 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:32.540121 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:32.540577 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:32.541002 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:32.576350 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:32.576830 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:32.577263 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:32.577699 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lazy-loading 'fault' on Instance uuid 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:28:32.618539 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:32.626094 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a34a0f27-f3a8-437a-879e-012551f99660 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 200 len: 1304 microversion: 2.1 time: 0.099226 Aug 30 01:28:32.626655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 501/1014] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:32 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:33.650285 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b85fd111-d4f6-48c9-9734-2d6418add829 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:33.650985 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b85fd111-d4f6-48c9-9734-2d6418add829 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:33.657220 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b85fd111-d4f6-48c9-9734-2d6418add829 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:33.657693 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b85fd111-d4f6-48c9-9734-2d6418add829 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:33.658121 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b85fd111-d4f6-48c9-9734-2d6418add829 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:33.658808 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b85fd111-d4f6-48c9-9734-2d6418add829 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:33.659252 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b85fd111-d4f6-48c9-9734-2d6418add829 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:33.659668 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b85fd111-d4f6-48c9-9734-2d6418add829 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:33.672974 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-b85fd111-d4f6-48c9-9734-2d6418add829 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] HTTP exception thrown: Instance 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 could not be found. Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b85fd111-d4f6-48c9-9734-2d6418add829 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Request method failure captured: Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 HTTP/1.1 Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Connection: close Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Host: 10.222.0.44 Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjDWewecSVtFM65i5Fv5uMl494dI_b3PXmnOkCaB5DygOCdObMpDY_p5y87WqzO3dTGPVjjsllfpFw_nlr0nEelwRhOZ6ZiL1I7GfObrjkmmNEbee-thIwy2tCCbKFjDHxc1fNnwTZSdXXmbZvsdADvkvRPpb6eysjqhpNSpA2FvNRGAQ Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Id: 6daea8caca73411abef8e14de09c5c54 Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-VolumesActionsTest-1639310916 Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Role: reader,member Aug 30 01:28:33.674571 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Roles: reader,member Aug 30 01:28:33.676332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6daea8caca73411abef8e14de09c5c54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6daea8caca73411abef8e14de09c5c54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6daea8caca73411abef8e14de09c5c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6daea8caca73411abef8e14de09c5c54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:28:33.676332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-VolumesActionsTest-1639310916 Aug 30 01:28:33.676332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 6daea8caca73411abef8e14de09c5c54 Aug 30 01:28:33.676332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-VolumesActionsTest-1639310916 Aug 30 01:28:33.676332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User: tempest-VolumesActionsTest-1639310916-project Aug 30 01:28:33.676332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 30 01:28:33.676332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 30 01:28:33.676332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Id: 282e92776c594100b697a79d0209be00 Aug 30 01:28:33.676332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-VolumesActionsTest-1639310916-project Aug 30 01:28:33.676332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: method: > Aug 30 01:28:33.676332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: exception: Instance 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 could not be found. Aug 30 01:28:33.676332 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: action_args: {'id': '99988bea-c46f-4a9e-a1c0-06a90a3ab7e8'} Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 could not be found. Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:28:33.678210 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 could not be found. Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 could not be found. Aug 30 01:28:33.679726 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 30 01:28:33.681048 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b85fd111-d4f6-48c9-9734-2d6418add829 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Returning 404 to user: Instance 99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:28:33.681048 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b85fd111-d4f6-48c9-9734-2d6418add829 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8" status: 404 len: 111 microversion: 2.1 time: 0.031247 Aug 30 01:28:33.681048 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 514/1015] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:33 2022] GET /compute/v2.1/servers/99988bea-c46f-4a9e-a1c0-06a90a3ab7e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:28:33.726254 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2109624462", "imageRef": "b8d44c08-9a89-4ab4-8457-ddd4fd0386d8", "flavorRef": "452", "networks": [{"uuid": "d538ef8f-d46e-45fe-b473-078cdd576896"}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:28:33.735006 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 01:28:33.735140 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Tue Aug 30 01:28:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.44) !!! Aug 30 01:28:33.784582 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] validate_networks() for [('d538ef8f-d46e-45fe-b473-078cdd576896', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:28:34.192690 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:28:34.193203 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:28:34.193675 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:28:34.194083 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:28:34.194488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:28:34.203155 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:34.203625 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:34.204082 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:34.204790 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:34.205236 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:34.205650 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:34.222073 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Getting quotas for project 6daea8caca73411abef8e14de09c5c54. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:28:34.226410 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Getting quotas for user 282e92776c594100b697a79d0209be00 and project 6daea8caca73411abef8e14de09c5c54. Resources: {'ram', 'instances', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:28:34.237559 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:28:34.240479 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8d44c08-9a89-4ab4-8457-ddd4fd0386d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:28:34.288025 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d167de04-78cc-4c70-9071-5bfc5f2906da tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565528 Aug 30 01:28:34.288709 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 502/1016] 10.222.0.44 () {60 vars in 1147 bytes} [Tue Aug 30 01:28:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:28:34.299375 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a816db3b-221d-40ad-9877-1ca10e75629f tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:34.299989 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a816db3b-221d-40ad-9877-1ca10e75629f tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:34.354314 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a816db3b-221d-40ad-9877-1ca10e75629f tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:34.361074 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a816db3b-221d-40ad-9877-1ca10e75629f tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 200 len: 1214 microversion: 2.1 time: 0.065494 Aug 30 01:28:34.361964 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 515/1017] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:34 2022] GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:35.384211 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4504b398-af06-4f15-8595-63330c087ad7 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:35.384866 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4504b398-af06-4f15-8595-63330c087ad7 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:35.393325 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4504b398-af06-4f15-8595-63330c087ad7 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:35.394098 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4504b398-af06-4f15-8595-63330c087ad7 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:35.394550 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4504b398-af06-4f15-8595-63330c087ad7 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:35.395296 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4504b398-af06-4f15-8595-63330c087ad7 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:35.395953 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4504b398-af06-4f15-8595-63330c087ad7 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:35.396379 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4504b398-af06-4f15-8595-63330c087ad7 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:35.494691 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4504b398-af06-4f15-8595-63330c087ad7 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:35.502424 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4504b398-af06-4f15-8595-63330c087ad7 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 200 len: 1284 microversion: 2.1 time: 0.123790 Aug 30 01:28:35.502986 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 503/1018] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:35 2022] GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 1284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:36.523527 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f274e1b1-d89c-463b-9c22-10b7902f852a tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:36.524222 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f274e1b1-d89c-463b-9c22-10b7902f852a tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:36.531642 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f274e1b1-d89c-463b-9c22-10b7902f852a tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:36.532230 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f274e1b1-d89c-463b-9c22-10b7902f852a tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:36.532673 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f274e1b1-d89c-463b-9c22-10b7902f852a tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:36.533352 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f274e1b1-d89c-463b-9c22-10b7902f852a tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:36.533838 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f274e1b1-d89c-463b-9c22-10b7902f852a tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:36.534325 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f274e1b1-d89c-463b-9c22-10b7902f852a tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:36.639951 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-6de87e3d-2bc7-4fe9-bbc3-515a16738f12 req-d318b820-90f0-438f-8844-b554f6336e0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231bdaf0-86bb-40f9-912b-946efb50ffcf", "tag": "1db1173c-6b1d-4ee2-8dae-8237b7347aff"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:28:36.653604 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-6de87e3d-2bc7-4fe9-bbc3-515a16738f12 req-d318b820-90f0-438f-8844-b554f6336e0a service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:36.654358 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-6de87e3d-2bc7-4fe9-bbc3-515a16738f12 req-d318b820-90f0-438f-8844-b554f6336e0a service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:36.655581 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-6de87e3d-2bc7-4fe9-bbc3-515a16738f12 req-d318b820-90f0-438f-8844-b554f6336e0a service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:36.677499 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-6de87e3d-2bc7-4fe9-bbc3-515a16738f12 req-d318b820-90f0-438f-8844-b554f6336e0a service nova] Creating event network-changed:1db1173c-6b1d-4ee2-8dae-8237b7347aff for instance 231bdaf0-86bb-40f9-912b-946efb50ffcf on hv-cinder-81514 Aug 30 01:28:36.682445 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-6de87e3d-2bc7-4fe9-bbc3-515a16738f12 req-d318b820-90f0-438f-8844-b554f6336e0a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049083 Aug 30 01:28:36.683081 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 504/1019] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:28:36.686500 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f274e1b1-d89c-463b-9c22-10b7902f852a tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:36.696124 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f274e1b1-d89c-463b-9c22-10b7902f852a tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 200 len: 1314 microversion: 2.1 time: 0.177171 Aug 30 01:28:36.696718 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 516/1020] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:36 2022] GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:37.719441 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8c7ec6fe-6c71-44c8-8392-601aff45b563 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:37.720208 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8c7ec6fe-6c71-44c8-8392-601aff45b563 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:37.727027 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c7ec6fe-6c71-44c8-8392-601aff45b563 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:37.727503 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c7ec6fe-6c71-44c8-8392-601aff45b563 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:37.727935 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c7ec6fe-6c71-44c8-8392-601aff45b563 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:37.728655 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c7ec6fe-6c71-44c8-8392-601aff45b563 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:37.729105 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c7ec6fe-6c71-44c8-8392-601aff45b563 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:37.729530 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c7ec6fe-6c71-44c8-8392-601aff45b563 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:37.941711 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8c7ec6fe-6c71-44c8-8392-601aff45b563 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:37.950361 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8c7ec6fe-6c71-44c8-8392-601aff45b563 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 200 len: 1314 microversion: 2.1 time: 0.235568 Aug 30 01:28:37.950947 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 505/1021] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:37 2022] GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:38.979296 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-31fe0e60-7008-409a-ad58-4056690198c4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:38.979896 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-31fe0e60-7008-409a-ad58-4056690198c4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:38.985940 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31fe0e60-7008-409a-ad58-4056690198c4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:38.986422 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31fe0e60-7008-409a-ad58-4056690198c4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:38.986859 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31fe0e60-7008-409a-ad58-4056690198c4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:38.987556 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31fe0e60-7008-409a-ad58-4056690198c4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:38.988018 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31fe0e60-7008-409a-ad58-4056690198c4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:38.988491 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31fe0e60-7008-409a-ad58-4056690198c4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:39.131605 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-31fe0e60-7008-409a-ad58-4056690198c4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:39.139604 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-31fe0e60-7008-409a-ad58-4056690198c4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 200 len: 1314 microversion: 2.1 time: 0.164960 Aug 30 01:28:39.140324 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 517/1022] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:38 2022] GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:40.160407 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4e2d89ca-a285-486e-99b9-897ac07413f4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:40.161016 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4e2d89ca-a285-486e-99b9-897ac07413f4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:40.167798 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e2d89ca-a285-486e-99b9-897ac07413f4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:40.168321 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e2d89ca-a285-486e-99b9-897ac07413f4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:40.168749 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e2d89ca-a285-486e-99b9-897ac07413f4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:40.169434 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e2d89ca-a285-486e-99b9-897ac07413f4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:40.169877 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e2d89ca-a285-486e-99b9-897ac07413f4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:40.170314 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e2d89ca-a285-486e-99b9-897ac07413f4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:40.305009 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4e2d89ca-a285-486e-99b9-897ac07413f4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:40.312672 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4e2d89ca-a285-486e-99b9-897ac07413f4 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 200 len: 1314 microversion: 2.1 time: 0.156050 Aug 30 01:28:40.313224 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 506/1023] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:40 2022] GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:41.081143 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-60547d4e-4a59-4459-b22d-01a12ed7cafd req-87fae1fb-c722-4e74-82eb-62821e2c8292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231bdaf0-86bb-40f9-912b-946efb50ffcf", "name": "network-vif-plugged", "status": "completed", "tag": "1db1173c-6b1d-4ee2-8dae-8237b7347aff"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:28:41.091354 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-60547d4e-4a59-4459-b22d-01a12ed7cafd req-87fae1fb-c722-4e74-82eb-62821e2c8292 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:41.091816 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-60547d4e-4a59-4459-b22d-01a12ed7cafd req-87fae1fb-c722-4e74-82eb-62821e2c8292 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:41.092302 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-60547d4e-4a59-4459-b22d-01a12ed7cafd req-87fae1fb-c722-4e74-82eb-62821e2c8292 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:41.104177 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-60547d4e-4a59-4459-b22d-01a12ed7cafd req-87fae1fb-c722-4e74-82eb-62821e2c8292 service nova] Creating event network-vif-plugged:1db1173c-6b1d-4ee2-8dae-8237b7347aff for instance 231bdaf0-86bb-40f9-912b-946efb50ffcf on hv-cinder-81514 Aug 30 01:28:41.109155 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-60547d4e-4a59-4459-b22d-01a12ed7cafd req-87fae1fb-c722-4e74-82eb-62821e2c8292 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031802 Aug 30 01:28:41.109958 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 518/1024] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:28:41.334529 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c32ea5fd-c7fd-4fbb-9c8a-b2aa8cda3714 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:41.335298 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c32ea5fd-c7fd-4fbb-9c8a-b2aa8cda3714 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:41.341901 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c32ea5fd-c7fd-4fbb-9c8a-b2aa8cda3714 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:41.342467 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c32ea5fd-c7fd-4fbb-9c8a-b2aa8cda3714 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:41.342977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c32ea5fd-c7fd-4fbb-9c8a-b2aa8cda3714 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:41.343753 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c32ea5fd-c7fd-4fbb-9c8a-b2aa8cda3714 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:41.344310 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c32ea5fd-c7fd-4fbb-9c8a-b2aa8cda3714 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:41.344810 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c32ea5fd-c7fd-4fbb-9c8a-b2aa8cda3714 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:41.476729 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c32ea5fd-c7fd-4fbb-9c8a-b2aa8cda3714 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:41.484294 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c32ea5fd-c7fd-4fbb-9c8a-b2aa8cda3714 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 200 len: 1314 microversion: 2.1 time: 0.154212 Aug 30 01:28:41.484852 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 507/1025] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:41 2022] GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:42.506675 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-36d94703-8e2f-47a5-8092-03004a65de1e tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:42.507385 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-36d94703-8e2f-47a5-8092-03004a65de1e tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:42.513894 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36d94703-8e2f-47a5-8092-03004a65de1e tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:42.514374 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36d94703-8e2f-47a5-8092-03004a65de1e tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:42.514813 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36d94703-8e2f-47a5-8092-03004a65de1e tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:42.515506 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36d94703-8e2f-47a5-8092-03004a65de1e tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:42.515960 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36d94703-8e2f-47a5-8092-03004a65de1e tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:42.516415 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36d94703-8e2f-47a5-8092-03004a65de1e tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:42.648618 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-36d94703-8e2f-47a5-8092-03004a65de1e tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:42.656406 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-36d94703-8e2f-47a5-8092-03004a65de1e tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 200 len: 1314 microversion: 2.1 time: 0.154710 Aug 30 01:28:42.656970 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 519/1026] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:42 2022] GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:43.678606 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-93b68cbb-7223-4f22-af66-4e1dc41c2d5c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:43.679283 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-93b68cbb-7223-4f22-af66-4e1dc41c2d5c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:43.685917 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-93b68cbb-7223-4f22-af66-4e1dc41c2d5c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:43.686404 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-93b68cbb-7223-4f22-af66-4e1dc41c2d5c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:43.686851 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-93b68cbb-7223-4f22-af66-4e1dc41c2d5c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:43.687550 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-93b68cbb-7223-4f22-af66-4e1dc41c2d5c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:43.688021 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-93b68cbb-7223-4f22-af66-4e1dc41c2d5c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:43.688457 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-93b68cbb-7223-4f22-af66-4e1dc41c2d5c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:43.820523 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-93b68cbb-7223-4f22-af66-4e1dc41c2d5c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:43.828405 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-93b68cbb-7223-4f22-af66-4e1dc41c2d5c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 200 len: 1498 microversion: 2.1 time: 0.154519 Aug 30 01:28:43.828977 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 508/1027] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:43 2022] GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:44.347423 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a20a1d89-d5f6-4daa-95f9-3122b30f3dfa tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:44.348068 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a20a1d89-d5f6-4daa-95f9-3122b30f3dfa tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:44.355499 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a20a1d89-d5f6-4daa-95f9-3122b30f3dfa tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:44.356051 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a20a1d89-d5f6-4daa-95f9-3122b30f3dfa tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:44.356493 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a20a1d89-d5f6-4daa-95f9-3122b30f3dfa tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:44.357192 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a20a1d89-d5f6-4daa-95f9-3122b30f3dfa tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:44.357646 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a20a1d89-d5f6-4daa-95f9-3122b30f3dfa tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:44.358079 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a20a1d89-d5f6-4daa-95f9-3122b30f3dfa tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:44.358626 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:44.384287 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a20a1d89-d5f6-4daa-95f9-3122b30f3dfa tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:28:44.461733 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a20a1d89-d5f6-4daa-95f9-3122b30f3dfa tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "DELETE /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 204 len: 0 microversion: 2.1 time: 0.117762 Aug 30 01:28:44.462367 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 520/1028] 10.222.0.44 () {58 vars in 1239 bytes} [Tue Aug 30 01:28:44 2022] DELETE /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:28:44.470846 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ecf978eb-065a-41bb-8c68-a1fe226049f3 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:44.471466 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ecf978eb-065a-41bb-8c68-a1fe226049f3 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:44.473496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:44.474152 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:44.480877 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecf978eb-065a-41bb-8c68-a1fe226049f3 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:44.481364 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecf978eb-065a-41bb-8c68-a1fe226049f3 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:44.481808 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecf978eb-065a-41bb-8c68-a1fe226049f3 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:44.482504 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecf978eb-065a-41bb-8c68-a1fe226049f3 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:44.482962 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecf978eb-065a-41bb-8c68-a1fe226049f3 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:44.483397 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecf978eb-065a-41bb-8c68-a1fe226049f3 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:44.619123 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ecf978eb-065a-41bb-8c68-a1fe226049f3 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:44.626851 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ecf978eb-065a-41bb-8c68-a1fe226049f3 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 200 len: 1504 microversion: 2.1 time: 0.159892 Aug 30 01:28:44.627499 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 509/1029] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:44 2022] GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:28:45.648996 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cc42a48f-e0ac-4bd1-883e-51cd29aeebee tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:45.649695 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cc42a48f-e0ac-4bd1-883e-51cd29aeebee tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:45.656346 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc42a48f-e0ac-4bd1-883e-51cd29aeebee tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:45.656860 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc42a48f-e0ac-4bd1-883e-51cd29aeebee tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:45.657298 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc42a48f-e0ac-4bd1-883e-51cd29aeebee tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:45.657993 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc42a48f-e0ac-4bd1-883e-51cd29aeebee tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:45.658482 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc42a48f-e0ac-4bd1-883e-51cd29aeebee tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:45.658909 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc42a48f-e0ac-4bd1-883e-51cd29aeebee tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:45.798494 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-cc42a48f-e0ac-4bd1-883e-51cd29aeebee tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:45.807109 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cc42a48f-e0ac-4bd1-883e-51cd29aeebee tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 200 len: 1504 microversion: 2.1 time: 0.162514 Aug 30 01:28:45.807680 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 521/1030] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:45 2022] GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:46.345867 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-96ea2267-d725-4fef-9d6c-377f87a98b7f req-af85cbf3-cdd6-47ca-85ca-435e913c63c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231bdaf0-86bb-40f9-912b-946efb50ffcf", "name": "network-vif-deleted", "tag": "1db1173c-6b1d-4ee2-8dae-8237b7347aff"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:28:46.364518 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-96ea2267-d725-4fef-9d6c-377f87a98b7f req-af85cbf3-cdd6-47ca-85ca-435e913c63c7 service nova] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:46.365002 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-96ea2267-d725-4fef-9d6c-377f87a98b7f req-af85cbf3-cdd6-47ca-85ca-435e913c63c7 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:46.365436 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-96ea2267-d725-4fef-9d6c-377f87a98b7f req-af85cbf3-cdd6-47ca-85ca-435e913c63c7 service nova] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:46.379644 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-96ea2267-d725-4fef-9d6c-377f87a98b7f req-af85cbf3-cdd6-47ca-85ca-435e913c63c7 service nova] Creating event network-vif-deleted:1db1173c-6b1d-4ee2-8dae-8237b7347aff for instance 231bdaf0-86bb-40f9-912b-946efb50ffcf on hv-cinder-81514 Aug 30 01:28:46.386318 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-96ea2267-d725-4fef-9d6c-377f87a98b7f req-af85cbf3-cdd6-47ca-85ca-435e913c63c7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043864 Aug 30 01:28:46.386944 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 510/1031] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Aug 30 01:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:28:46.827868 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:46.828524 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:46.834967 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:46.835455 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:46.835959 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:46.836844 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:46.837301 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:46.837731 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:46.869831 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:46.870320 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:46.870760 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:46.871213 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lazy-loading 'fault' on Instance uuid 231bdaf0-86bb-40f9-912b-946efb50ffcf {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:28:46.913885 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282e92776c594100b697a79d0209be00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daea8caca73411abef8e14de09c5c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:28:46.921366 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2fcd12e8-87bc-4fb1-b7b2-cdeec7b1610c tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 200 len: 1304 microversion: 2.1 time: 0.097344 Aug 30 01:28:46.921936 dv-cinder-815145-12-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 522/1032] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:46 2022] GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:28:47.942695 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c57e7364-bde3-4d38-9d08-876099321041 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:28:47.943396 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c57e7364-bde3-4d38-9d08-876099321041 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] [instance: 231bdaf0-86bb-40f9-912b-946efb50ffcf] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:28:47.950797 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c57e7364-bde3-4d38-9d08-876099321041 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:47.951279 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c57e7364-bde3-4d38-9d08-876099321041 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:47.951712 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c57e7364-bde3-4d38-9d08-876099321041 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:47.952437 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c57e7364-bde3-4d38-9d08-876099321041 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Acquiring lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:28:47.952888 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c57e7364-bde3-4d38-9d08-876099321041 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:28:47.953309 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c57e7364-bde3-4d38-9d08-876099321041 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Lock "c7c422da-0cce-49b5-ba78-bc23108abcf4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:28:47.957488 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:47.968981 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-c57e7364-bde3-4d38-9d08-876099321041 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] HTTP exception thrown: Instance 231bdaf0-86bb-40f9-912b-946efb50ffcf could not be found. Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c57e7364-bde3-4d38-9d08-876099321041 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Request method failure captured: Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf HTTP/1.1 Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Connection: close Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Host: 10.222.0.44 Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjDWewecSVtFM65i5Fv5uMl494dI_b3PXmnOkCaB5DygOCdObMpDY_p5y87WqzO3dTGPVjjsllfpFw_nlr0nEelwRhOZ6ZiL1I7GfObrjkmmNEbee-thIwy2tCCbKFjDHxc1fNnwTZSdXXmbZvsdADvkvRPpb6eysjqhpNSpA2FvNRGAQ Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Id: 6daea8caca73411abef8e14de09c5c54 Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesActionsTest-1639310916 Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 30 01:28:47.970761 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 30 01:28:47.972527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6daea8caca73411abef8e14de09c5c54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6daea8caca73411abef8e14de09c5c54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6daea8caca73411abef8e14de09c5c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6daea8caca73411abef8e14de09c5c54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Aug 30 01:28:47.972527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesActionsTest-1639310916 Aug 30 01:28:47.972527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 6daea8caca73411abef8e14de09c5c54 Aug 30 01:28:47.972527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesActionsTest-1639310916 Aug 30 01:28:47.972527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesActionsTest-1639310916-project Aug 30 01:28:47.972527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 30 01:28:47.972527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 30 01:28:47.972527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Id: 282e92776c594100b697a79d0209be00 Aug 30 01:28:47.972527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesActionsTest-1639310916-project Aug 30 01:28:47.972527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: method: > Aug 30 01:28:47.972527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: exception: Instance 231bdaf0-86bb-40f9-912b-946efb50ffcf could not be found. Aug 30 01:28:47.972527 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: action_args: {'id': '231bdaf0-86bb-40f9-912b-946efb50ffcf'} Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 231bdaf0-86bb-40f9-912b-946efb50ffcf could not be found. Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:28:47.973687 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 231bdaf0-86bb-40f9-912b-946efb50ffcf could not be found. Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 231bdaf0-86bb-40f9-912b-946efb50ffcf could not be found. Aug 30 01:28:47.975496 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 30 01:28:47.977672 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c57e7364-bde3-4d38-9d08-876099321041 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] Returning 404 to user: Instance 231bdaf0-86bb-40f9-912b-946efb50ffcf could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:28:47.977672 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c57e7364-bde3-4d38-9d08-876099321041 tempest-VolumesActionsTest-1639310916 tempest-VolumesActionsTest-1639310916-project] 10.222.0.44 "GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf" status: 404 len: 111 microversion: 2.1 time: 0.033720 Aug 30 01:28:47.977672 dv-cinder-815145-12-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 511/1033] 10.222.0.44 () {58 vars in 1236 bytes} [Tue Aug 30 01:28:47 2022] GET /compute/v2.1/servers/231bdaf0-86bb-40f9-912b-946efb50ffcf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)